-- Logs begin at Wed 2022-08-10 16:08:34 UTC, end at Wed 2022-08-10 17:20:43 UTC. -- Aug 10 16:48:22.801580 dv-cinder-836027-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 16:48:22.811091 dv-cinder-836027-6-smb devstack@keystone.service[81386]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 16:48:22 2022] *** Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: nodename: dv-cinder-836027-6-smb Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: machine: x86_64 Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: clock source: unix Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: pcre jit disabled Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: detected number of CPU cores: 4 Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: current working directory: / Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: detected binary path: /usr/bin/uwsgi-core Aug 10 16:48:22.813664 dv-cinder-836027-6-smb devstack@keystone.service[81386]: your processes number limit is 47680 Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: your memory page size is 4096 bytes Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: detected max file descriptor number: 2048 Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: lock engine: pthread robust mutexes Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: thunder lock: enabled Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 16:48:22.814246 dv-cinder-836027-6-smb devstack@keystone.service[81386]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 16:48:22.853127 dv-cinder-836027-6-smb devstack@keystone.service[81386]: Python main interpreter initialized at 0x55b1ee8e39c0 Aug 10 16:48:22.853127 dv-cinder-836027-6-smb devstack@keystone.service[81386]: python threads support enabled Aug 10 16:48:22.853127 dv-cinder-836027-6-smb devstack@keystone.service[81386]: your server socket listen backlog is limited to 100 connections Aug 10 16:48:22.853127 dv-cinder-836027-6-smb devstack@keystone.service[81386]: your mercy for graceful operations on workers is 90 seconds Aug 10 16:48:22.853492 dv-cinder-836027-6-smb devstack@keystone.service[81386]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 16:48:22.853568 dv-cinder-836027-6-smb devstack@keystone.service[81386]: *** Operational MODE: preforking *** Aug 10 16:48:22.853798 dv-cinder-836027-6-smb devstack@keystone.service[81386]: *** uWSGI is running in multiple interpreter mode *** Aug 10 16:48:22.853798 dv-cinder-836027-6-smb devstack@keystone.service[81386]: spawned uWSGI master process (pid: 81386) Aug 10 16:48:22.853988 dv-cinder-836027-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 16:48:22.855492 dv-cinder-836027-6-smb devstack@keystone.service[81386]: spawned uWSGI worker 1 (pid: 81397, cores: 1) Aug 10 16:48:22.855492 dv-cinder-836027-6-smb devstack@keystone.service[81386]: spawned uWSGI worker 2 (pid: 81398, cores: 1) Aug 10 16:48:22.855492 dv-cinder-836027-6-smb devstack@keystone.service[81386]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 16:48:28.461423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:48:28.461423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Aug 10 16:48:28.462222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:48:28.462222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Aug 10 16:48:28.468755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:48:28.468755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Aug 10 16:48:28.469224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 16:48:28.469224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Aug 10 16:48:28.511854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:48:28.512057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:48:28.512254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] command line args: [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:48:28.512551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:48:28.512732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ================================================================================ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:48:28.512988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.513237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_dir = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.513429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.513616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_source = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.513798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] debug = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.513997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.514502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.514602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.514792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_config_append = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_dir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.515995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.516231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.516501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.516742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.517003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.517174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.517353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.517613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.517695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 16:48:28.517807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 16:48:28.517896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] command line args: [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 16:48:28.518121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 16:48:28.518518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ================================================================================ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 16:48:28.518630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.518975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_dir = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_source = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.519984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] debug = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] publish_errors = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.520991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] standard_threads = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.521937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_config_append = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_dir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_journal = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_json = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.522780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_stderr = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_syslog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.523544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.523770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.523881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.523992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.524167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.524298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.524414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.524576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.524696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.524810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.524934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.525050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.525169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.525289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.525403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.525570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.525687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.525806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.525926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.526046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.526159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.526280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.526395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.526508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.526620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.526732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.526845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.526966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.527195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.527312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.527451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.527699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.527816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.527942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.528057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] publish_errors = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.528170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.528282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.528407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.528540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.528668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.528783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.528923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.529041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.529163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.529338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.529456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.529590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.529708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] standard_threads = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.529820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.529942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.530057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.530218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.530336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.530455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.530574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.530709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_journal = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.530825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.530937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_json = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.531049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.531160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_stderr = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.531272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.531604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_syslog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.531817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.531981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 16:48:28.532103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.532103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.532103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.532427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.532562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.532778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.533013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.533245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.533484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.533733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.533964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.534202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.534432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.534682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.534907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.535155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.535386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.535624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.535862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.536909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.537963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.538187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.538304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.538423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.538539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.539181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.539424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.539729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.539983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.540956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.541907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.542930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.543959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.544972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.545935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.546975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.547915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.external = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.548885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.password = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.token = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.549927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.550972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.551896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.552948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.553997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.554112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.554237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.554909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.555945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.556897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.557884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.558983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.559922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.560888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.561953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.562981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.563944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.external = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.564995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.password = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.token = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.565939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.566965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.567907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.568923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.569902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.570939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.571983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.572949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.573909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.574970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.575901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.576986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.577914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.578992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.579925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.580902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.581948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.582884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.583955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.584914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.585961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.586902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.587939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.588919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.589923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.590971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.591796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.592963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.593907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.594965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.595915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.596915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.597963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.598933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.599755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.600498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.600498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.600498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.600814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.600928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.601931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.602293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.602543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.602908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.603153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.603388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.603622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.603854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.604116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.604373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.604645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.604884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.605120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.605350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.605585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.605820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.606064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.606300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.606578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.606805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.607041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.607288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.607529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.607772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.608006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.608242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.608475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.608739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.608985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.609213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.609453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.609738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.609995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.610236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.610479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.610713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.610949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.611183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.611415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.611648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.611881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.612123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.612357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.612620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.612853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.613096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.613328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.613568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.613794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.614030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.614262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 16:48:28.614428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 16:48:28.628290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.628552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.628781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.638595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.640999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.641231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.641453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.651635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.667379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.667610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.670737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.670968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.723327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.723462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.774654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.774889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.776255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.776499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.839522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.839755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.839982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.840207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.840429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.840670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.841230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.841461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.841683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.841901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.842117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.842330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.863619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.863853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.864964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.865048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.865193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.865412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.865626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.865843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.876736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.877592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.890953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.891810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.892027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 16:48:28.908281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.908522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 16:48:28.908644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.908844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 16:48:28.908931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 16:48:28.909188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 16:48:28.909607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.909952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.910134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.910214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.910388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.921714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.921813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.921998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.922091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.922270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.922366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.922555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.922636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.930070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.930171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.933166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.933280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.933457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.933540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.933746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.933828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.934929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.935941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.936019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.959595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.960004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.961636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.961920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.962059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.962353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.966527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.966815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.966958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.967104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.967244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.967530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.973766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.974021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.974103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.974365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.978801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.978903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:28.979095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.979962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.980901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.996408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.996715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.996993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:28.997281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.000617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.001306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.003731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.004034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.004457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.004783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.008518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.009515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.011650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.012708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.014828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.015131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.015430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.015732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.015864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.016017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.016174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.016307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.016469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.016792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.017078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.017365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.032946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.033242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.033515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.033781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.034030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.034324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.034596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.034869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.041371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.042374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.042935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.043214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.043921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.044206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.046031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.046319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.046611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.046902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.047027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.047182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.047316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.047619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.047921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.048207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.058512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.058794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.059072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.059350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.059629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.059711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.059904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.059996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.060181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.060267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.060464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.060772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.061051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.061332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.076959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.078216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.079885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.081188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.082825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.084126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.084404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.086270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.086455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.086735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.087026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.087758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.088058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.088346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.093519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.094774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.095109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.096376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.098062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.098358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.098642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.098916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.099337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.099636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.099926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.100212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.106965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.107258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.107540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.108402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.108722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.109013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.114358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.114646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.114928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.115205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.115478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.115752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.115860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 16:48:29.116027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.116152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.116296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.116442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.116734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.116819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.117988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.118157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.118289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.118577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.118857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.119129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.119410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.119685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 16:48:29.152231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b1ee8e39c0 pid: 81398 (default app) Aug 10 16:48:29.153754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b1ee8e39c0 pid: 81397 (default app) Aug 10 16:48:29.155554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c84-11a5-46b9-b27d-5a6c1e4c82b1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:29.155842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c84-11a5-46b9-b27d-5a6c1e4c82b1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:29.156115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c84-11a5-46b9-b27d-5a6c1e4c82b1 None None] PATH_INFO: `/v3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:29.160401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed Aug 10 16:48:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:36.756451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:36.757000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:36.757097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:36.761503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:48:36.766619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:36.767080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:36.767174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:36.837945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: INFO dbcounter [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] Registered counter for database keystone Aug 10 16:48:36.857496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:48:36.863579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writer thread running {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:48:37.043278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 16:48:37.043609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 16:48:37.098338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:37.099917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:37.229406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 16:48:37.369353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:37.437753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: INFO dbcounter [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] Registered counter for database keystone Aug 10 16:48:37.459420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG oslo_db.sqlalchemy.engines [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 16:48:37.466115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writer thread running {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 16:48:37.583628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf3793-aaf5-4e2c-98ba-0486f05a0288 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:37.588609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:37.589221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:37.589500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:37.589773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:37.597741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:37.650572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 16:48:37.650912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947ff60-fb85-4895-a5da-084d48fbeb41 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:37.660649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 10 16:48:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 16:48:37.667352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:37.682328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd294f9-16ec-401e-bea3-e8db401385ba None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:37.686834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:37.687958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:37.688239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:37.688534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] PATH_INFO: `/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:37.690006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] RBAC: Authorizing `identity:get_project(project_id=cac92c6a1cc54a05870dbe2cd79f672b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:37.742628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 16:48:37.742906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4e9a-9ccc-4e36-9af5-6d85bfeac81a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:37.747479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Aug 10 16:48:37 2022] GET /identity/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:39.735895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb148-3d0e-463a-82e2-1379acf42ead None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:39.736414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb148-3d0e-463a-82e2-1379acf42ead None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:39.736414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421eb148-3d0e-463a-82e2-1379acf42ead None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:39.740576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:39.746141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:39.746556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:39.746682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:39.768492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:39.770016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:39.778941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 16:48:39.801851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421eb148-3d0e-463a-82e2-1379acf42ead None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:39.813779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421eb148-3d0e-463a-82e2-1379acf42ead None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:39.817956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:39.818536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:39.818813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:39.819081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:39.827354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:39.829134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1da79d-22a7-4a5c-9fd1-39c5c5ef8a8a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:39.838265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 10 16:48:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 16:48:39.843512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:39.852739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cb1b9-622c-4210-89f8-0deb66556b81 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:39.857108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:39.857723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:39.858003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:39.858275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:39.859589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:39.861456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03459-823f-44ec-b675-9eba8a6749e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:39.862950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed Aug 10 16:48:39 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:41.959174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14882-f301-46c6-badc-02137d5c8d08 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:41.959670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14882-f301-46c6-badc-02137d5c8d08 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:41.959670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14882-f301-46c6-badc-02137d5c8d08 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:41.961575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:41.966581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:41.966995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:41.967135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:41.985309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:41.986469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:41.995849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda7d3-5226-4d68-ab33-6c51d766662d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:41.996128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda7d3-5226-4d68-ab33-6c51d766662d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:41.996389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eda7d3-5226-4d68-ab33-6c51d766662d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:41.997726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:48:42.002854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.003137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.003413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.046097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 16:48:42.046525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 16:48:42.075426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:42.093090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:42.094685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:42.096775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.121285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.196826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:42.201442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607af18-4dd9-4a12-8d0c-425fa59e598f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.220762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.236509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.237134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.237414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.237685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.305068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.306543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.321629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703983ad-d766-4ea7-873c-85b951804c6b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.324146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.331389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.361134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.362240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.362526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.362805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.374669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:42.383188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:42.384119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:48:42.384978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 8/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:48:42.390330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.407926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 7/15] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:48:42.413314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.489954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd1d93-28e9-40c8-8ab0-bf1acfe06aa3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.512240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7f2f0-2ea5-4b21-9576-82cfaacec794 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.523875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.524467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.524775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.525045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.525703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:42.526002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.527474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.538354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.543608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 9/16] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:42.549168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.549873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.550510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.550793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.551069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.561784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.563272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.578072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:48:42.582732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:42.583684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:48:42.584468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:48:42.584468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:48:42.584468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:48:42.584468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 8/17] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:48:42.590296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.658322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229079-59c6-4f2e-b8d1-4b6f5f78ea15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.696066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.696731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.697013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.697285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.699103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.700592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.702392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:42.707627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.795965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7764ed-06ed-45a9-94eb-4270bafd0ae2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.799880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:42.807723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e0278-837c-4537-a9fa-34b89199e4b0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.830857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.831460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.831737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.832013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.832701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:42.833004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.834393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b757e31-4d25-4e4f-a70a-3cf0a58de3b9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.842454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.843074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.843353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.843627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.844767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.846196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:42.847724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 11/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:42.851609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 9/20] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:42.854049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:42.958538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1148356-dc10-4a57-9479-007e38b5fb94 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:42.994490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:42.995089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:42.995367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:42.995642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:42.996382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.domain.id=default, user.id=0c82076d9dfe480f9a7e9f70455b47e8) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:42.996720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:42.998167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebdaee-bebe-416f-8876-be6e8a96e708 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:43.007055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 12/21] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 10 16:48:42 2022] GET /identity/v3/role_assignments?user.id=0c82076d9dfe480f9a7e9f70455b47e8&scope.domain.id=default&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:45.430888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f90da-0cb4-408d-a417-2071f27048ec None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.431401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f90da-0cb4-408d-a417-2071f27048ec None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.431476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f90da-0cb4-408d-a417-2071f27048ec None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.432847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 10/22] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:45.438431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.438897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.438974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.462882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:45.464125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:45.471521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a0e4-656a-4af8-8b47-5713385756f4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.471807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a0e4-656a-4af8-8b47-5713385756f4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.472079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430a0e4-656a-4af8-8b47-5713385756f4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.473412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 11/23] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:45.478352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199499de-4b50-4c94-9dcb-2369ad52a8ab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.478639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199499de-4b50-4c94-9dcb-2369ad52a8ab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.478909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199499de-4b50-4c94-9dcb-2369ad52a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.512270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-199499de-4b50-4c94-9dcb-2369ad52a8ab None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:45.512819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:45.513494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-199499de-4b50-4c94-9dcb-2369ad52a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:45.573506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:45.583912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 13/24] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:45.634283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:45.667121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 12/25] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:45.696500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703b7f-784c-46e7-9b28-c4af503d0492 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.696500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703b7f-784c-46e7-9b28-c4af503d0492 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.696500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703b7f-784c-46e7-9b28-c4af503d0492 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.696500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 13/26] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:45.703436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.704043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.704549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.740302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:45.742831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:45.812279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d758d3-9985-4327-a311-1c568ebbfe75 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:45.849474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:45.850463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:45.851563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:45.852049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:45.852455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:45.853458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:45.872823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:45.874628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ea87ffda-c210-4392-a469-a565eca8fbfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:48:45.892175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:45.893107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:48:45.893907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:48:45.893907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:48:45.893907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:48:45.895688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 14/28] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:48:45.966175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:45.974129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd2f6-ce5a-45da-b208-590062befa2a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.012687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2720c4-fc02-4920-b092-e2d7ec4c786b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.013299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2720c4-fc02-4920-b092-e2d7ec4c786b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.013746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2720c4-fc02-4920-b092-e2d7ec4c786b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.014731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.015420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.015772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.015986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 15/29] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:45 2022] GET /identity => generated 270 bytes in 120 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:46.016115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.016935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2720c4-fc02-4920-b092-e2d7ec4c786b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.017052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:46.018501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:46.032166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:46.142486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2720c4-fc02-4920-b092-e2d7ec4c786b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.162251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 10 16:48:45 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:46.164858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.202704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.205201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.205740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.206185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.207560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:46.213303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b9bc1-de21-4924-89a2-f0034a858d09 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:46.376888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced5bf5-f529-4317-8aee-41ec2d3f3dd7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.406104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 16/31] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/roles => generated 225 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:46.407894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130150f1-e0f9-438d-a6c3-5a9e85345d77 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.408401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130150f1-e0f9-438d-a6c3-5a9e85345d77 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.414769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130150f1-e0f9-438d-a6c3-5a9e85345d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.421498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.422142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.422429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.422707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.423389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:46.423698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:46.425333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:46.451405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:46.452698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-130150f1-e0f9-438d-a6c3-5a9e85345d77 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:46.454277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-130150f1-e0f9-438d-a6c3-5a9e85345d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:46.457636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.490094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:46.578604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:46.591993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:46.598726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df6e3-35f4-4dfb-a6c3-e4cec9794a14 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.599305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df6e3-35f4-4dfb-a6c3-e4cec9794a14 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.599586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798df6e3-35f4-4dfb-a6c3-e4cec9794a14 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.601268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 18/34] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:46.607885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.608178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.608454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.631146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9279c34-ff18-45db-b0e4-4a6596224939 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.633055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:46.634107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:46.685155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.685793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.686074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.686348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.686994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:46.688434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:46.727062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 17/35] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:46.727927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.745130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 19/36] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:46.768961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.826644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:46.873611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b36df7-3da3-4b2c-8e04-2674d03974a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.891306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc201-d9e6-42f0-8609-5a1e73ae48e4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:46.915678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.916329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.916644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.916921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.923614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:46.930543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:46.934482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:46.935084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.935364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.935640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.936303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f04e2f93-3042-448f-9299-5ebc9bf8d4b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:46.937080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:46.937901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:46.941319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:48:46.941916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e80dd-fd03-4a05-b609-bebf555825f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:46.941984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 18/37] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:48:46.941984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a8e8-3e63-474c-a20f-653e9a272b35 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.941984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a8e8-3e63-474c-a20f-653e9a272b35 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.941984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799a8e8-3e63-474c-a20f-653e9a272b35 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.941984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 19/38] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:46.944161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799a8e8-3e63-474c-a20f-653e9a272b35 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:46.959151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:46.961034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:46.961330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:46.961679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:46.982080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:46.983674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:47.063347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:47.069909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799a8e8-3e63-474c-a20f-653e9a272b35 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.087946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:47.112132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:47.118264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.119084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.119189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.119415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.120093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:47.120394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.121832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.137120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 20/41] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:47.140772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:47.204058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681de4b-f6bb-4b3f-96c2-53d420521612 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.220956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:47.238678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.239297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.239576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.239847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.240983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.243150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.244727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 22/42] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:47.248604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffbabd-485b-4c07-b079-5b5875b0e7d3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.250985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:47.283083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.283713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.283995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.284273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.285452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.286901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.289046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:47 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:47.294391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:47.349307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b112e-5144-4fe0-a8c7-224ffbcaae99 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.351707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:47.385463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.386068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.386347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.386630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.387263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.388742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.394773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5eb4e-3cd8-4502-90a6-09726d5657e3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.417525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:48:47 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:48:47.432188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.432881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.433162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.433434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.434631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.436126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a250ca4-fc42-498d-8f48-1a8748c4de2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.437806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 22/45] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:47.443886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:47.488451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:47.554763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f230133-16af-44f1-b853-8a84f6f6ab3e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:47.590203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:47.590857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:47.591136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:47.591412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] PATH_INFO: `/v3/domains/default/users/0c82076d9dfe480f9a7e9f70455b47e8/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:47.593374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0c82076d9dfe480f9a7e9f70455b47e8, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:47.594816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d112c-0b9f-4adb-99a2-87bf4191c3b8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:47.609015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 24/46] 10.222.0.39 () {58 vars in 1361 bytes} [Wed Aug 10 16:48:47 2022] PUT /identity/v3/domains/default/users/0c82076d9dfe480f9a7e9f70455b47e8/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:48:49.437755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2268fd-0a2d-4f00-a24a-727be424ec20 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.438269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2268fd-0a2d-4f00-a24a-727be424ec20 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.438351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2268fd-0a2d-4f00-a24a-727be424ec20 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.439632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:49.445004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4a8c-3a65-4c66-b303-309b523c03f4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.445398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4a8c-3a65-4c66-b303-309b523c03f4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.445562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a4a8c-3a65-4c66-b303-309b523c03f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.463667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f94a4a8c-3a65-4c66-b303-309b523c03f4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:49.464875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f94a4a8c-3a65-4c66-b303-309b523c03f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:49.531269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:49.553930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2268fd-0a2d-4f00-a24a-727be424ec20 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:49.611915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87040-fc02-4d9a-9f86-3efd015f3c84 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.612197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87040-fc02-4d9a-9f86-3efd015f3c84 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.612475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b87040-fc02-4d9a-9f86-3efd015f3c84 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.613839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 26/49] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:48:49.619351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.619641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.619918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.637718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:49.638887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:49.656238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2268fd-0a2d-4f00-a24a-727be424ec20 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:49.662051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:49.681764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:49.695549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:49.696182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.696458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.696759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.697869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:49.699579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:49.701165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 24/50] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:49.707075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:49.708083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 27/51] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:49.731529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:49.808339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e0ccd-0362-461a-8fee-32c3362fe8da None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:49.831076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07658b7a-45ee-482e-bf07-a8f3faf99609 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:49.841745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:49.842348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.842628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.842900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.843537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:49.845019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:49.864874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:49.865839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:49.866314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:49.867285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:49.873123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 25/52] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 10 16:48:49 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:48:49.877619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:49.883122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:49.884019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:48:49.884827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:48:49.890863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:49.940505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:49.999608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4c24-31f3-4a73-be7d-2fadd700cb34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:50.034362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:50.034979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:50.035261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:50.035536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:50.036211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:50.036541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:50.037927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:50.046686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 26/54] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:50.052462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:50.072444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:50.153069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad417f-fb00-4fa4-8f62-b772129b1abe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:50.185730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:50.186353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:50.186637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:50.186913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:50.188044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:50.189530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:50.191235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 29/55] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:50 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:50.197388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:50.299860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7019928-0321-480e-9039-590d00b2a84c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:50.307265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:50.334309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:50.334934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:50.335232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:50.335516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:50.336656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:50.338422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448f6a-f1af-42f5-9edb-5c96dc612bd5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:50.339988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 27/56] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:50.345781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:50.427869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:50.443258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d13c4e-528e-4e28-a563-c2bac7137bdd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:50.475470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:50.476592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:50.476842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:50.477110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:50.477826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.domain.id=default, user.id=0c82076d9dfe480f9a7e9f70455b47e8) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:50.478127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:50.479546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bc058-4cea-4d60-8c4a-9c7fb12c0ee0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:50.485089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 30/57] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 10 16:48:50 2022] GET /identity/v3/role_assignments?user.id=0c82076d9dfe480f9a7e9f70455b47e8&scope.domain.id=default&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:51.888742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d835e-0e94-4ce4-9bc0-5ee206caa3b8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:51.889243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d835e-0e94-4ce4-9bc0-5ee206caa3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:51.889328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d835e-0e94-4ce4-9bc0-5ee206caa3b8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:51.890612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 28/58] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:51.895717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:51.896076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:51.896263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:51.916005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:51.917205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:51.983291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:52.007585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d835e-0e94-4ce4-9bc0-5ee206caa3b8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:52.108143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d835e-0e94-4ce4-9bc0-5ee206caa3b8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:52.139714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:52.140332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:52.140646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:52.140922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:52.142021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:52.143462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300419-f157-46e3-8525-c38d1acf3229 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:52.145023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 29/60] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:52.151068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:52.228984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:52.247980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b11f9c-21c1-4172-a5c0-4b6fdcef7972 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:52.281876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:52.282464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:52.282744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:52.283015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:52.283659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:52.285125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1b55-be14-4ea2-abc2-a38d803252fe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:52.311066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:48:52 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:55.397185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167fc7-2a83-4a51-8ba4-92eb0d0f77c1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.398704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167fc7-2a83-4a51-8ba4-92eb0d0f77c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.399250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18167fc7-2a83-4a51-8ba4-92eb0d0f77c1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.400859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 30/62] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:55.406075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.406892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.407362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.433488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:55.435045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:55.521884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:55.545207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d22a-7139-489a-9fe8-dbf02e05d074 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.545796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d22a-7139-489a-9fe8-dbf02e05d074 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.546270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99d22a-7139-489a-9fe8-dbf02e05d074 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.547796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 31/64] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:55.556786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:55.570304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.570898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.571381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.590278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:55.592173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:55.643276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:55.656266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:55.684782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 32/65] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:48:55.709386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:55.716470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667836c-014e-4e00-986e-de05c272ee5b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:55.777521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:55.778499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.779177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.781406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.810670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5da72cad-4b20-4e8b-952c-17dda27ab3bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:55.815991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:55.816844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:48:55.817667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:48:55.820231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 34/66] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:48:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:48:55.826359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2e68-4575-453d-8efe-fdfad1766dd8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.826953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2e68-4575-453d-8efe-fdfad1766dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.827427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee2e68-4575-453d-8efe-fdfad1766dd8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.828943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 35/67] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:55.830977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee2e68-4575-453d-8efe-fdfad1766dd8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:55.866214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc0999-46cb-4493-947e-edcdbfa290a3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:55.914112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:55.914948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.915241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.915517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.930000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-352b3547-cc22-4670-8bc5-1ce70b3d6d0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:55.936229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:55.937123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:48:55.937864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:48:55.938455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 33/68] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:48:55.939580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.939866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.940228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.952253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee2e68-4575-453d-8efe-fdfad1766dd8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:55.960024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:55.961349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:55.979196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:55.988173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:55.988807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:55.989094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:55.989369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:55.989994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:55.990098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:55.990329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:55.992374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52ee2-920b-4eef-856f-8c4df0e73a0e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.001326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 36/69] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:56.002491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475275c3-2434-44db-84f7-7a250ee15836 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.002774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475275c3-2434-44db-84f7-7a250ee15836 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.003050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475275c3-2434-44db-84f7-7a250ee15836 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.004248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 37/70] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:56.004970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475275c3-2434-44db-84f7-7a250ee15836 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.041286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 34/71] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:56.042547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.125615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475275c3-2434-44db-84f7-7a250ee15836 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.160520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.161110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.161277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf851408-59c0-461a-8cda-1762423cb9a5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.161374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.161654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.162318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:56.162629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.164041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6a58c-7a42-4d47-8b37-a0cebd4451aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.177669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:56.177669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.177669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.177669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.192184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:56.193401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:56.202612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.203247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.203530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.203805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.204994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.206448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.208182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 35/73] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:56.208788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.238732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.240645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.262210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 39/74] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:56.263054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.312568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767e5da-4f5b-4f99-9a88-2d14b5c71cba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.346523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.347150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.347435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.347711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.357644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:56.361821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197613a6-4649-4f29-acdd-95a2f8340a46 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-876b1473-6cd4-4d1c-bc0e-5b5c74f1e1c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:56.362792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:56.363620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:48:56.364366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 36/75] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:48:56.365032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb992-230c-49fa-bac2-565a301c959c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.365300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb992-230c-49fa-bac2-565a301c959c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.365648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb992-230c-49fa-bac2-565a301c959c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.367169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 37/76] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:56.367894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cb992-230c-49fa-bac2-565a301c959c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.400713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.401338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.401630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.401906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.417567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.419017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.420851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 40/77] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:56.421494 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.462049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.464532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.475159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cb992-230c-49fa-bac2-565a301c959c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.508758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.509363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.509647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.509925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.524072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03856e30-8c43-4a5c-8ff8-dae7b7c2819b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.558318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.558937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.559219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.559494 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.560627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.562078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.563636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 41/78] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:56.564399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.578554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.580013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd522d4-fe48-4e12-b445-36058f05ed91 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.664742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050365e-22da-4e04-b25f-24a78770cc79 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.666989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.672276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.677622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 38/79] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:56.681815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.682112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.682398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.700467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:56.701691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:56.702238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.702848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.703128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.703401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.704078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:56.704389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.705841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.714303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 42/80] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:56.715028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.768151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 39/81] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:56.784701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:56.814822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b649b-2fef-435f-a005-1c7621fbd55a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.848913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.849520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.849803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.850081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.867032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9632d6-3a06-4daf-92f7-2982d56a217d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:56.885011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.888230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:56.903354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:56.903967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:56.904252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:56.904540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:56.905181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.906627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.919520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:56.921014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:56.932235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 40/82] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:48:56 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:48:56.933621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.038900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 43/83] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:57.040085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.049720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d3c59-ba34-48d8-85ee-2f132ebe4328 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.087675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.088325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.088642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.088920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.090079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.091528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.093214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 41/84] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:48:56 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.093979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.125192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.150142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.167746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5c5b5-3c60-4fc4-8335-524140b22631 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.215811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0f621-1f93-4846-9b01-5105568cb7d6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.217399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.218828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.218828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.218828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.220607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.226338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.228468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 44/85] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.229054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.261288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.262115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.262472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.262853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.275641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:48:57.280752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:48:57.281783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:48:57.282707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:48:57.285203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 42/86] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:48:57.289576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.349934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8488e7-7982-4630-aceb-0d674a55aa91 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.385691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.386475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.386858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.387240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.388510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.390219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.392980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 45/87] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.393275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.396943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.416561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190d2dd-360f-42d9-b102-e28276d827b5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.422459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.469615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.470478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.470719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.470997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.471728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=0c82076d9dfe480f9a7e9f70455b47e8) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:57.472036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.473644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.481352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 43/88] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/role_assignments?user.id=0c82076d9dfe480f9a7e9f70455b47e8&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.482198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.522564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e10c-01e6-4515-bd61-74eb818581b4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.570592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.571447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.572302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.572772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.599763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091094f2-e6a3-4d84-9400-d69238114ab3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.685608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.686233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.686513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.686788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.687460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:57.687761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.689212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.708204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 44/89] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.709080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.719907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.721700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.733306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.768809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:57.898221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72316e78-b51c-4664-a620-6ebf105a40e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:57.907365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 46/90] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:57.912672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:57.967117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:57.968890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:57.970001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:57.970636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:57.972598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:57.973297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:57.976644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:57.990137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:57.991967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:58.113363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4914bed-37a9-46ed-a5b7-f24eb1eea4a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:58.122059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:58.168987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:58.170278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:58.170762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:58.171235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:58.173174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:58.174908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:58.176942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 47/92] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:58.183636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:58.188162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:58.201013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c9d1-0bae-43c6-8112-7859c92d89fc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:58.284426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:58.287041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:58.287530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:58.292932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:58.294266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:58.295757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:58.297474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:48:57 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:58.303366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:58.360057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bcc6f-437c-4463-ad58-2cd808484c79 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:58.402458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:58.403474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:58.404002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:58.404471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:58.458915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:58.492458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:58.494893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:58.608738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503682a-d633-49a0-aa23-ebb21bc968c2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:58.663024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 48/94] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:48:58.669219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:58.698012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:58.698633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:58.699170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:58.699448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:58.700183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:58.700505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:58.701962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:58.722328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 47/95] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:48:58 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=19aab39ee8c04f399191428b85e73932 => generated 259 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:58.805751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:58.850499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1c97-2f82-492f-b841-0f1ee55d6566 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:58.904304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:58.904994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:58.905281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:58.905556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] PATH_INFO: `/v3/projects/1480a2de16f347ac8221191732390afd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:58.906747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] RBAC: Authorizing `identity:get_project(project_id=1480a2de16f347ac8221191732390afd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:58.908301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56b401-0fed-401e-9f43-1ecafafb8334 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:58.910113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 49/96] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:48:58 2022] GET /identity/v3/projects/1480a2de16f347ac8221191732390afd => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:48:58.916562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:58.953776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:59.061014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a6829-fd17-4220-91bd-7c8fedbb92a0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:48:59.109970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781837-8129-4623-a495-df638fc3e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:48:59.110582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781837-8129-4623-a495-df638fc3e856 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:59.110864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781837-8129-4623-a495-df638fc3e856 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:59.111137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781837-8129-4623-a495-df638fc3e856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:59.111862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781837-8129-4623-a495-df638fc3e856 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=1480a2de16f347ac8221191732390afd, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:48:59.112167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781837-8129-4623-a495-df638fc3e856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:48:59.113636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781837-8129-4623-a495-df638fc3e856 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:48:59.125136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:48:58 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=1480a2de16f347ac8221191732390afd&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:48:59.636375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd416-1e8b-4ad7-b03a-d2cb813d9f7c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:59.636767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd416-1e8b-4ad7-b03a-d2cb813d9f7c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:59.636980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd416-1e8b-4ad7-b03a-d2cb813d9f7c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:59.638294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 50/98] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:59.643404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:59.643838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:59.644003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:59.665985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:59.667179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:59.737542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd53dd6-9f90-4d3a-b8e0-20e0579bb097 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:59.738035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd53dd6-9f90-4d3a-b8e0-20e0579bb097 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:59.738134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd53dd6-9f90-4d3a-b8e0-20e0579bb097 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:59.739666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 51/99] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:48:59.750740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:48:59.751033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:48:59.751318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:48:59.758296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 49/100] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:59.785490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:48:59.786707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:48:59.841030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:48:59.892845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:48:59.911266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 52/101] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:48:59.956032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:00.047071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c28ad-9936-4525-90ac-04638df21a96 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:00.136550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:00.139493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:00.140200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.140499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.140805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.173880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:00.178513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:00.180551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:00.181311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 50/102] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:48:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:00.191412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:00.212721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154e22d-3400-421c-b171-4c1a2f678adc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:00.274908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:00.275542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.275817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.276088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.277753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:00.279193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:00.280977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 53/103] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:48:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:00.286969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:00.343237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:00.380236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1f010-5f18-40f7-a43c-f0ca2a119812 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:00.454738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:00.455273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.455554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.455826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.456538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:00.456817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:00.458231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:00.482435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 51/104] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:00.487793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:00.500392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528405-498e-41de-bb05-af08d1314763 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:00.577818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:00.578441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.578726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.578998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.579649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:00.581174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb9240-40ea-4c3c-a18e-072955592876 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:00.596857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:00.624546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 54/105] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:49:00 2022] POST /identity/v3/projects => generated 302 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:00.633925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69100-bc7c-4669-a034-0161917cbaa4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.634672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69100-bc7c-4669-a034-0161917cbaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.635236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69100-bc7c-4669-a034-0161917cbaa4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.636895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 55/106] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:00.660465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.661135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.661621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.709060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3a353-dc22-4a69-b3cb-b7f418c9fc2c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:00.727321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:00.728884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:00.817240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:00.817900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:00.818189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:00.818468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] PATH_INFO: `/v3/users/70e7b6bec4f242a2825fbceba274c6fc` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:00.849692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:00.857218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] RBAC: Authorizing `identity:get_user(user_id=70e7b6bec4f242a2825fbceba274c6fc)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:00.858713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:00.860437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 52/107] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:00 2022] GET /identity/v3/users/70e7b6bec4f242a2825fbceba274c6fc => generated 289 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:00.865934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:00.890286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 56/108] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:00.912790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.035226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb431873-6034-40e8-b8c0-316ab7cc81e0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.063620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ad5a-6a3a-457d-8f2e-8e03cc1d44ee None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.068004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:01.090082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.091348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.092083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.092638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.104557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.105506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.105857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.106280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:01.106513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f58edf7e-695c-4595-a513-b08b0c4c474a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:01.112414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:01.113531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:01.114472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:01.115447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 57/109] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:01.121586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac43b2-7a5a-41f3-94c5-955543d28896 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.124339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac43b2-7a5a-41f3-94c5-955543d28896 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.124832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac43b2-7a5a-41f3-94c5-955543d28896 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.127714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 58/110] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:01.128511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac43b2-7a5a-41f3-94c5-955543d28896 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.207359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:01.211909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:01.213751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:01.271878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac43b2-7a5a-41f3-94c5-955543d28896 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.312337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.313170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.313550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.313923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.314939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:01.315345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:01.317788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7dc77-cffb-4879-b6be-a41315c777e7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:01.327849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 59/111] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:01.329086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.329590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.329959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.355619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:01.355619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:01.380208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 53/112] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:49:01.381390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.400935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:01.478824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 60/113] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:01.479931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.580697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:01.584153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01826ed-49ff-4731-80ec-f210e96fa697 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.652031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.652712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.653001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.653281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.654497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:01.656019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:01.657646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 54/114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:01.661751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.665323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5f310-dce9-4bab-b691-1ee6d7380ce8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.713384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.714257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.714709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.715127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.716475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:01.718226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:01.720131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 61/115] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:01.721197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.769944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:01.803326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c8cb-655c-494f-9fba-5f93b227e921 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.833252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc86004-e74c-4415-aeaa-77d39315544b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:01.853362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.854135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.854508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.854911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.870418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:01.873047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:01.873896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.874353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.874798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.876106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-02e948e7-537c-40bf-a907-47537f709a36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:01.876259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:01.877207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:01.878043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 55/116] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:01.879089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3045cb-6139-4586-9ec1-73df1e56d822 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:01.879266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3045cb-6139-4586-9ec1-73df1e56d822 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:01.879531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3045cb-6139-4586-9ec1-73df1e56d822 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:01.881129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:01.881236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 56/117] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:01.882054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3045cb-6139-4586-9ec1-73df1e56d822 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.883324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 62/118] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:01.888819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:01.921008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.012091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eec72-d0ff-40ef-bab7-f898d8e808b1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.024897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.027523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3045cb-6139-4586-9ec1-73df1e56d822 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.056877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.057512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.058028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.058305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.058977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:02.059276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.061375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef557e8-00be-47f0-8467-d85b17f1886a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:02.072914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 63/119] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:02.074246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.074380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f74d-e173-4ac6-a2fa-6f0311456d15 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.074633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f74d-e173-4ac6-a2fa-6f0311456d15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.074910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5f74d-e173-4ac6-a2fa-6f0311456d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.075419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.075839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.076248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.077150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=70e7b6bec4f242a2825fbceba274c6fc) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:02.077597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.079200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:02.085971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 57/120] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:01 2022] GET /identity/v3/role_assignments?user.id=70e7b6bec4f242a2825fbceba274c6fc&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d58ddb2305af400f85567a6c9c200990 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:02.086995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.095651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2ac5f74d-e173-4ac6-a2fa-6f0311456d15 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:02.096920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2ac5f74d-e173-4ac6-a2fa-6f0311456d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:02.174177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 64/121] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:02.182483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6068-4460-4891-a469-edb48d3237a7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.182984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6068-4460-4891-a469-edb48d3237a7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.183441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6068-4460-4891-a469-edb48d3237a7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.184863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 65/122] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:02.185619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6068-4460-4891-a469-edb48d3237a7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.205399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.215640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f376b-137d-4559-a9e3-51b48a67662a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.266930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.267579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.267864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.268141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/users/0c82076d9dfe480f9a7e9f70455b47e8/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.270842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, user_id=0c82076d9dfe480f9a7e9f70455b47e8, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.272457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452731ef-6e8a-4b41-925c-7b5d73fb907c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:02.290141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 58/123] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:02 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/users/0c82076d9dfe480f9a7e9f70455b47e8/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:02.292527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.292527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.292527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.324513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:02.325759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:02.353210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.361237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef6068-4460-4891-a469-edb48d3237a7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.440045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.441070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.441556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.442030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.443547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.445807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:02.452556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 66/124] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:02 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:02.453745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.456719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 59/125] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:02.458441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.562892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.591563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb984-6f2f-48d6-80c3-c64244c97aa3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.612974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e44e-c8db-41e5-9f83-0e96a434b2dc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.635329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.635981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.636266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.636605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.638218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.639876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:02.641707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 60/126] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:02 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:02.642775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.678203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.679526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.680016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.680535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.701897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:02.713412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:02.714311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:02.715056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 67/127] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:02.715689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.773229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.810539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f4499-d3ef-402a-be54-43c7c7825e16 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.874277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.876398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.876711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.877044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.892237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc0b62-cb04-43a2-8f59-5e8f3e1109cc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:02.894379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:02.905286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:02.906160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:02.906909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:02.907484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 61/128] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:02.908039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:02.927839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:02.983062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:02.983735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:02.984020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:02.984290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/users/f5a53e96d82348b78ee94b66e1baa542/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:02.987763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, user_id=f5a53e96d82348b78ee94b66e1baa542, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:02.990607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.020915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 68/129] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:02 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/users/f5a53e96d82348b78ee94b66e1baa542/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:03.021964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.081238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d093fe-8fc4-43a9-b387-ff8e221147cc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.154712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.155402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.155697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.155978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.156778 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:03.157102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.158607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.175075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 62/130] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:03.188251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.214778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:03.228683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db06ea-0530-4e38-9adf-f136698463f5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.283262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.283928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.284215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.284503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.285187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:03.285545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.286923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.296059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 69/131] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:03.301793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.319997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:03.387948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdb35e-d2be-4151-88ee-f32921b74edb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.445023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.445594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.445886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.446162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.447371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.448872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759a1d2-a202-4762-b6ce-817151e3f536 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.451070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 63/132] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:03.452218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537603-ba85-45d1-9131-4f8d2fd9a40b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.456502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537603-ba85-45d1-9131-4f8d2fd9a40b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.456502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537603-ba85-45d1-9131-4f8d2fd9a40b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.456502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 64/133] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:03.459051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537603-ba85-45d1-9131-4f8d2fd9a40b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.464596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65ab2d-cca9-49bb-b322-132cf71ab7d5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.531680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.532324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.532643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.532925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.534085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.536057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f52d25-f575-44cd-bc66-3f05499671f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.537813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 70/134] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:03.539751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.540463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.540778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.573216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:03.574649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:03.606633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:03.656876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537603-ba85-45d1-9131-4f8d2fd9a40b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.673372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:03.676580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.720554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.721207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.721491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.721867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.723001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.724446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.727587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 65/136] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:03.740172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.770917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:03.814143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166828a5-4dd1-4d48-9e37-b6430147d29c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:03.850456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:03.851893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:03.852175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:03.852519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] PATH_INFO: `/v3/projects/1480a2de16f347ac8221191732390afd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:03.853665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] RBAC: Authorizing `identity:get_project(project_id=1480a2de16f347ac8221191732390afd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:03.855113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:03.857043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 72/137] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/projects/1480a2de16f347ac8221191732390afd => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:03.858035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:03.885950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:03.967014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2b93b-6dba-4a59-9a8c-42b932092426 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:04.002834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:04.003508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.003796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.004075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.005362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:04.006854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:04.008403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 73/138] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:04.009388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce383d0-db20-44f3-a01e-a91df069071d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:04.013273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:04.085567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:04.086047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.086406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.086774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/users/f5a53e96d82348b78ee94b66e1baa542/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.093813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, user_id=f5a53e96d82348b78ee94b66e1baa542, role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:04.095281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:04.103790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:04.120968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dbe78-6a2c-40bf-a65c-25814af6395f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:04.125676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 66/139] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:03 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/users/f5a53e96d82348b78ee94b66e1baa542/roles/19aab39ee8c04f399191428b85e73932 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:04.126532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:04.191323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:04.192027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.192306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.192600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] PATH_INFO: `/v3/projects/1480a2de16f347ac8221191732390afd/users/f5a53e96d82348b78ee94b66e1baa542/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.195164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] RBAC: Authorizing `identity:create_grant(project_id=1480a2de16f347ac8221191732390afd, user_id=f5a53e96d82348b78ee94b66e1baa542, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:04.196884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71fd9-887a-43b5-8c45-4e4e84a69c8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:04.228798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 74/140] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:04 2022] PUT /identity/v3/projects/1480a2de16f347ac8221191732390afd/users/f5a53e96d82348b78ee94b66e1baa542/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:04.244736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:04.288256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad832633-e76a-4f3d-99a4-53d13fe5e01a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:04.327587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:04.328226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.328540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.328822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.329783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:04.331088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efbabf-8572-45b1-94db-cb7502974e88 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:04.357142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 67/141] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:04 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:04.821775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec083-4652-44f2-b046-c66bf46bab51 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.822160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec083-4652-44f2-b046-c66bf46bab51 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.822454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec083-4652-44f2-b046-c66bf46bab51 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.824232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 75/142] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:04.830199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a271-cb6a-478d-aecd-9c2ea279f8c9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:04.830768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a271-cb6a-478d-aecd-9c2ea279f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:04.831234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a271-cb6a-478d-aecd-9c2ea279f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:04.856138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5b16a271-cb6a-478d-aecd-9c2ea279f8c9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:04.857670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5b16a271-cb6a-478d-aecd-9c2ea279f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:04.952522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 68/143] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:04.998634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ec083-4652-44f2-b046-c66bf46bab51 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.120593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ec083-4652-44f2-b046-c66bf46bab51 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.137473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6f98-c6a8-4b89-9cc8-0006a03a93e3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.138421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6f98-c6a8-4b89-9cc8-0006a03a93e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.138910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b6f98-c6a8-4b89-9cc8-0006a03a93e3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.140438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 69/144] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:05.145941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.146486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.146958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.165930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:05.166566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.166841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.167112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.191382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:05.192169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:05.196473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:05.200862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:05.201747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:05.202514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:05.203218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 76/145] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:05.212075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.220205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:05.309736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:05.343674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 70/146] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:05.352306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3e38-ed3f-47b3-8707-6ba89d9c78a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.384308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.399791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:05.400545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.400823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.401095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.401776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:05.402080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:05.405403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:05.423226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 77/147] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:05.428439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.532385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:05.581015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bda84-a82d-4f83-a88e-3258824d0e60 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.622761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:05.623853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.624131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.624401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] PATH_INFO: `/v3/users/0c82076d9dfe480f9a7e9f70455b47e8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.625631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] RBAC: Authorizing `identity:get_user(user_id=0c82076d9dfe480f9a7e9f70455b47e8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:05.627170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:05.629072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 78/148] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:05 2022] GET /identity/v3/users/0c82076d9dfe480f9a7e9f70455b47e8 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:05.635362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.638530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0ef49-f62f-47d3-90a5-16b02b6504cd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.701206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:05.701868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.702154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.702433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.717722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-11f5da25-a216-4139-a00a-39c3680d4e9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:05.722540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:05.723375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:05.724139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 71/149] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:05.733886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e23f-3e58-4079-901a-c45ee7d2fcad None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.734178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e23f-3e58-4079-901a-c45ee7d2fcad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.734474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4e23f-3e58-4079-901a-c45ee7d2fcad None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.736356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 72/150] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:05.738214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4e23f-3e58-4079-901a-c45ee7d2fcad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:05.753525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ea5-a62a-4edf-8093-e54b82001187 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.795025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:05.795565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:05.795844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:05.796116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:05.803775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:05.819484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:05.931452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4e23f-3e58-4079-901a-c45ee7d2fcad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:05.935862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:05.938366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.001025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.001654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.001934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.002198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.002882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:06.003181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.004594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6245c6-913a-4cb6-8f8c-bce720b56091 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.014817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 73/151] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:06.016073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.016358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.016664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.055234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:06.057083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:06.115048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 79/152] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:06.115904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.161859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 74/153] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:06.162782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.166243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:06.220070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:06.299206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af961a-f975-4722-91ce-72e2a7940443 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.299551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b101a7-2978-4267-b3b4-2299c057e6fc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.336362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.336705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.336894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.337166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.338837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.340299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.342641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 75/154] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:06.343777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.378134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.378783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.379067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.379352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] PATH_INFO: `/v3/users/70e7b6bec4f242a2825fbceba274c6fc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.380516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] RBAC: Authorizing `identity:get_user(user_id=70e7b6bec4f242a2825fbceba274c6fc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.382565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.384520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 80/155] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/users/70e7b6bec4f242a2825fbceba274c6fc => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:06.385301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.454018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefdb26-a6c2-4454-bb75-b8221b67aeea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.480871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:06.497112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.497971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.498676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.499093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.516165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:06.523274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:06.524297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:06.525485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:06.527727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 76/156] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:06.533258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.686626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8246-7cdd-4949-bf20-450f578b3283 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.709356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73f9f6-dcba-4e4e-a467-2394a40041fd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.711699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:06.752200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.752869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.753150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.753425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.754568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.756019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.760507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 77/157] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:06.766737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.779601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.780570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.781111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.781576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.782502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=0c82076d9dfe480f9a7e9f70455b47e8) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:06.782997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.784660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.791518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 81/158] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/role_assignments?user.id=0c82076d9dfe480f9a7e9f70455b47e8&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:06.797485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:06.822796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:06.922979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7243-3c1b-42f7-835b-ad2600f3dc1e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.954524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7debfcd-8dde-4845-b760-2aae394e6f21 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:06.976773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:06.977581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:06.977864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:06.978131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:06.978821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:06.979119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:06.984614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:06.994715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 78/159] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:07.000806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:07.025834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:07.026514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.026842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.027164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/users/70e7b6bec4f242a2825fbceba274c6fc/roles/d58ddb2305af400f85567a6c9c200990` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.031466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, user_id=70e7b6bec4f242a2825fbceba274c6fc, role_id=d58ddb2305af400f85567a6c9c200990)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:07.033118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:07.058458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 82/160] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:06 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/users/70e7b6bec4f242a2825fbceba274c6fc/roles/d58ddb2305af400f85567a6c9c200990 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:07.162308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:07.171113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cdae5-f30a-4e54-8640-6c6f03d15d5d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:07.215418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:07.215975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.216251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.216538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.217676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:07.219140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:07.220814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 79/161] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:06 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:07.227491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:07.276954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:07.373683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e6c9-43dd-4e71-9394-f487903f3977 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:07.410780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:07.411768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.412249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.412749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.497400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:07.499182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:07.551560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:07.616060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 83/162] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:07.622826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:07.781115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0fe39-c84f-4eea-9929-4de7df34bdac None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:07.830315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:07.831322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.831805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.832588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.833975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:07.835774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c4407-3ca8-43c2-918b-7c9410dabb9f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:07.837663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 80/163] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:07 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:07.843732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:07.882740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0743-53be-41a2-bc97-7f2238d08488 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.883382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0743-53be-41a2-bc97-7f2238d08488 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.883872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff0743-53be-41a2-bc97-7f2238d08488 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.885464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 81/164] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:07.901384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3df5-1060-4d89-8935-fb9fd199547e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:07.901997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3df5-1060-4d89-8935-fb9fd199547e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:07.902620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce3df5-1060-4d89-8935-fb9fd199547e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:07.928455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-08ce3df5-1060-4d89-8935-fb9fd199547e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:07.930385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08ce3df5-1060-4d89-8935-fb9fd199547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:07.958440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:07.992840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11e745-68cb-4604-be20-586cf9f297c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.010329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:08.012184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3601-cfab-457c-b306-05cea43ec919 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.012705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3601-cfab-457c-b306-05cea43ec919 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.013184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd3601-cfab-457c-b306-05cea43ec919 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.014736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 83/166] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:08.021930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.023052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.023528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.028638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:08.043383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.043903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.044221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.044518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.045434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:08.045740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:08.047214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:08.048127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:08.049675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:08.054323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 84/167] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:07 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:08.067724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.130486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 84/168] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:08.193028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.193969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbc9c8-8be4-47e7-831f-1d4fd708bfd9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.277917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.278540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.278789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.279033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.305687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:08.311067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:08.312359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:08.313180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:08.318720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.400382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:08.432994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608c200-47a8-4b3c-bebb-227faccfee8e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.434946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:08.514079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.514737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.515014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.515284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.540367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:08.545107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:08.546006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:08.546804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:08.551477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 85/170] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:08.552396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb15696-3ee3-45b0-9d76-e119eecb7128 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.553241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.635701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.636277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.636583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.636875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.637527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:08.637824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:08.639193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:08.654271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 86/171] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:08.659678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.816230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf005c-bacb-4477-a4ac-3417a2b2fe72 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.893665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf42e-93ae-4a42-9104-090fa2921b6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:08.906831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.907814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.908345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.909206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.910208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:08.911020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:08.912982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:08.915299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:08.934772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 86/172] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:08.940705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:08.961560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:08.962575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:08.963207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:08.963484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:08.966536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:08.967067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:08.969046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:08.970578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 87/173] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:08.976892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.076234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865c0-2409-4967-9e8e-4d0e75d04523 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.130785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:09.133215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.134098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.134595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] PATH_INFO: `/v3/users/f5a53e96d82348b78ee94b66e1baa542` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.139060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] RBAC: Authorizing `identity:get_user(user_id=f5a53e96d82348b78ee94b66e1baa542)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:09.141218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade7bc-9afb-4b22-b037-b5fdb663fd05 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:09.144108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 87/174] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/users/f5a53e96d82348b78ee94b66e1baa542 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:09.148124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d4f9-c443-4ae2-afb5-276559b19241 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.150547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d4f9-c443-4ae2-afb5-276559b19241 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.151114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d4f9-c443-4ae2-afb5-276559b19241 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.153887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 88/175] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:09.155989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d4f9-c443-4ae2-afb5-276559b19241 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.208312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f68f9-6eb0-4bc3-b65b-d93974851d23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.280698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:09.281464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.281691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.281910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.298623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.330154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d4f9-c443-4ae2-afb5-276559b19241 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.354731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.371985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:09.374077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815cd7-e5fe-4424-90e9-621e896bd0b4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:09.385116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:09.385728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.386472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.386749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.478429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:09.479876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7077413-f80b-48d6-89c7-38f728226747 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:09.496329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 88/176] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:09.497893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003e99-39f7-40fd-9fd5-d2327df2c983 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.498233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003e99-39f7-40fd-9fd5-d2327df2c983 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.498572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003e99-39f7-40fd-9fd5-d2327df2c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.518713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c5003e99-39f7-40fd-9fd5-d2327df2c983 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:09.519884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5003e99-39f7-40fd-9fd5-d2327df2c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:09.573249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 89/177] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f14f9-be4b-4398-b00b-dc5138216b6c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f14f9-be4b-4398-b00b-dc5138216b6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f14f9-be4b-4398-b00b-dc5138216b6c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 90/178] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:09.596080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f14f9-be4b-4398-b00b-dc5138216b6c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.603549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:09.604825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec63ec-2a01-4a20-87db-dd81a96b93d9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.605106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec63ec-2a01-4a20-87db-dd81a96b93d9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.605375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec63ec-2a01-4a20-87db-dd81a96b93d9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.608271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 90/180] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:09.613053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.613440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.613835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.616874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.634359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:09.635527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:09.711346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 91/181] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:09.715304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f14f9-be4b-4398-b00b-dc5138216b6c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.723609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.752716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:09.753368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.753651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.753925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] PATH_INFO: `/v3/projects/1480a2de16f347ac8221191732390afd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.755152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] RBAC: Authorizing `identity:get_project(project_id=1480a2de16f347ac8221191732390afd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:09.756907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b348ff8-b73b-4020-b9a4-929ea222a46e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:09.758849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 91/182] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:09 2022] GET /identity/v3/projects/1480a2de16f347ac8221191732390afd => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:09.761706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.762619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.763145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.783712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:09.784917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:09.833334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc409cd2-cc4d-47ea-9943-037dacff24a1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.845821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.862068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 92/183] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:09.870767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:09.871399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:09.871673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:09.871942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:09.873067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:09.873529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.874516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:09.880959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 92/184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:09 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:09.882535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:09.887829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:09.986075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc075ea-c957-4a35-9080-cd5acf6dedbd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:09.995091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea4eb2-62f6-4ee3-8bcc-c9f571fb51c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.020655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.021202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.021479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.021746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.031967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.032238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:10.032635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.032917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.033189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:10.036942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:10.037829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:10.039105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:10.041770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 93/185] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:10.041770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.050156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:10.055489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:10.056383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 93/186] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:10.057542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.097089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.121348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.154683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb92c55-c0ec-4ce0-b479-ab9a58414097 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.158392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f70e8-26a2-4948-bbb4-6fe048655060 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.187850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.188437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.188757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.189024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.189742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=1480a2de16f347ac8221191732390afd, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:10.190045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.191470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.191913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.192538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.192831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.193106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.193832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=f5a53e96d82348b78ee94b66e1baa542) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:10.194142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.196339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.197760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 94/187] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=1480a2de16f347ac8221191732390afd&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.198639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.202287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 94/188] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/role_assignments?user.id=f5a53e96d82348b78ee94b66e1baa542&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=19aab39ee8c04f399191428b85e73932 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.203112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.345771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf7584-0955-4560-8621-b2e0fcf8d002 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.347780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.367753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad0d2-13d7-4978-810f-269d60ce7898 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.391270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.391270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.391270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.391617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.393595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:10.393595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.393831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.404503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 95/189] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.405350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.406469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.416754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.417385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.417660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.417966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.419826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.421281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf31ac-f21f-456d-8502-008c6e2d133e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.422856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 95/190] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.424174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf432-31b1-45c1-9398-c20e9a3cf770 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.424455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf432-31b1-45c1-9398-c20e9a3cf770 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.424751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf432-31b1-45c1-9398-c20e9a3cf770 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.426217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 96/191] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:10.426926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf432-31b1-45c1-9398-c20e9a3cf770 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.555007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44994-9eda-47e6-88c1-858055ea4cf1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.570949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf432-31b1-45c1-9398-c20e9a3cf770 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.596293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.597023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.597373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.597657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.598500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:10.598807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.600203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.606290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.607144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.607570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.607844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.609156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.613402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.623394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.624880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc02007-e38a-4111-8b69-e29fd89adb85 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.626544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.627772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.628055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.628324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.646845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:10.648327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.648738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:10.713822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.728045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 98/194] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:10.733504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.747916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf739ee-81a3-41b3-8c66-e5373f32e8b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.786039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.786649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.786930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.787201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.787842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.789645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.810808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 97/195] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:10 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:10.811759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.850796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3840f-bc11-4a95-a316-d399cb9706c1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.891893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.892563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.892841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.893111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:10.894322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:10.895800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:10.901986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 99/196] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:10.901986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:10.916966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.939628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26381-d04b-49db-80cd-751460c55959 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:10.966215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:10.981063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:10.981715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:10.982093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:10.982460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.024435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003d8f3-3f4d-4378-b4ef-857300d2593c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.065263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.066222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.066680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.067141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.068367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.070542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.083819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:11.088864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:11.089722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 100/197] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:11.090916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.188959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.211438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 98/198] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:11.212475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.218669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b783-3ab0-43bb-bcc6-28b9879c70b6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.243489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.268943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.270131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.271041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.271595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.341796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc92984-6e5f-447a-8d4c-6141aa2e0e37 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.357301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.359980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.380310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.381126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.381593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.382028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.382883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:11.383284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.384799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.398263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:11.399421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.460975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.493555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 101/200] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:11.494484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.513047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.518459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1299-7767-4159-a13d-c269fe991902 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.566546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.568131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.568931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.569462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.572006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.573769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.575911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:11.576927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.611391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07c40-8357-4f6a-b8c0-07fc16783b1a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.649502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.650027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.650311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.650585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] PATH_INFO: `/v3/users/70e7b6bec4f242a2825fbceba274c6fc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.651736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] RBAC: Authorizing `identity:get_user(user_id=70e7b6bec4f242a2825fbceba274c6fc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.655507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.655507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/users/70e7b6bec4f242a2825fbceba274c6fc => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:11.655707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.726549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceba249-05b9-41e7-b010-5a71bcf1b1f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.745270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.758894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:11.779669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5fb21-17de-4548-ab9b-28e5b9cc4240 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:11.780475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.781625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.782946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.783426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.784817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.786488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.789725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 101/203] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:11.790711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.822659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:11.823294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:11.823815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:11.823939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:11.825085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=f67070df89694bdd81364aa040f4e7c9) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:11.825349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:11.826974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:11.832958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/role_assignments?user.id=f67070df89694bdd81364aa040f4e7c9&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:11.837519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:11.970639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5710a-1d28-409c-ba8a-55348e787e72 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:12.005795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab66c86-f8c4-468e-80f4-6a2ad4a62091 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:12.042763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:12.043432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:12.043721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:12.044001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:12.048857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:12.049660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:12.050095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:12.050509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:12.051385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=f67070df89694bdd81364aa040f4e7c9) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:12.051844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:12.053454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:12.061344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 104/205] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/role_assignments?user.id=f67070df89694bdd81364aa040f4e7c9&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=19aab39ee8c04f399191428b85e73932 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:12.128688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:12.145304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:12.147106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:12.279113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 102/206] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:12.284920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:12.301393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:12.394901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e13315-679c-4cd5-a549-51a5e3ffd963 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:12.430661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:12.431528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:12.431977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:12.432391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:12.433681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:12.435303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326360a-ad54-435b-a2c1-ee752279499f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:12.437432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 105/207] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:12 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:12.445913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:12.556939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:12.576956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4865da-e850-454c-8d62-64b9077df24d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:12.613516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:12.614367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:12.614814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:12.615577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:12.617047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, scope.project.id=fd84e43ba49e48038d55d63483289724, user.id=70e7b6bec4f242a2825fbceba274c6fc) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:12.617604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:12.619206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bb1a-e6c5-4497-98fe-b357fbe82d21 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:12.626049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 103/208] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:12 2022] GET /identity/v3/role_assignments?user.id=70e7b6bec4f242a2825fbceba274c6fc&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d58ddb2305af400f85567a6c9c200990 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:13.137573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963044-f61c-43b6-84d6-2b6f2a2e9164 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.138526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963044-f61c-43b6-84d6-2b6f2a2e9164 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.138959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963044-f61c-43b6-84d6-2b6f2a2e9164 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.140512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 106/209] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:13.145849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.146399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.146877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.167271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:13.168815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:13.201725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424933-f4a4-4a85-9b48-fe7bf8e1f1e9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.202181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424933-f4a4-4a85-9b48-fe7bf8e1f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.202466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424933-f4a4-4a85-9b48-fe7bf8e1f1e9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.204198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 107/210] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:13.209728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.210543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.210805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.237395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:13.238982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:13.262176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 104/211] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:13.286872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.336602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 108/212] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:13.364965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.374734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:13.378335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:13.416507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c225077-96db-4418-9402-f7c31a9e5e22 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:13.464668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:13.468861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.469244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.469877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.481452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab794b-c953-4a4b-a5f5-552c3673f5db None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:13.485037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:13.490044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:13.490934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:13.492310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:13.499811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 105/213] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:13.500929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.523184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:13.523870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.524156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.524427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.526116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:13.528083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:13.530393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 109/214] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:13.535817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.613896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c3344-cc96-477d-82eb-bd6cb4a3a10d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:13.620577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:13.643923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58378dea-ea4c-442b-892d-b41a60bd2a2c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:13.655492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:13.656412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.656920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.657397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.658288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:13.658785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:13.660372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:13.662136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:13.672087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 106/215] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:13.677764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.684462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:13.687378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.687378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.687378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.687378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:13.687733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:13.724624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 110/216] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:13 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:49:13.804729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe29680-61aa-43d0-a8ea-35bc1211fe34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:13.843893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:13.844885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:13.845317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:13.845735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] PATH_INFO: `/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:13.861870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ca1280dbf3459fb9b709b5d3122a7b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:13.863601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:13.865587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 107/217] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:13 2022] GET /identity/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:13.874179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:13.996302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc89f2-0493-4a9b-a35e-f67001ea4f8f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:14.034325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:14.035181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.035633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.036050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.039608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:14.110725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:14.112262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdc327-05c1-406a-b17e-72eddacf97b8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:14.217392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 111/218] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:14.223025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:14.287115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:14.308154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dbe06-ef2a-4bef-91c5-499d5d4da511 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.308457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dbe06-ef2a-4bef-91c5-499d5d4da511 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.308746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dbe06-ef2a-4bef-91c5-499d5d4da511 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.310102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 112/219] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:14.316324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.316740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.317016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.345367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c298-7f3e-4332-91a3-38eee44b5396 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:14.347582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:14.348777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:14.383525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:14.393431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:14.394101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.395292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.395570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.396854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:14.398359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:14.400304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 108/220] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:14.407091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:14.443172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 113/221] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:14.466852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:14.531944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dfae1-c2a5-4c0c-bbc3-9fac8e396f67 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:14.564923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:14.580254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:14.581339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.581703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.582224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.583374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=a8ca1280dbf3459fb9b709b5d3122a7b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:14.583958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:14.586007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97add37c-f140-4049-8b6e-8f37122c2de7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:14.586384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98670423-fa1f-4384-a3d0-73789cd074c1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:14.593208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 109/222] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/role_assignments?user.id=a8ca1280dbf3459fb9b709b5d3122a7b&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:14.601718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458c60-31de-4ddb-83b1-3b406e5f6316 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.604379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458c60-31de-4ddb-83b1-3b406e5f6316 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.604713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458c60-31de-4ddb-83b1-3b406e5f6316 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.612533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 110/223] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:14.612533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.612533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.612533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.645371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:14.646580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:14.660505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:14.661173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.661451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.661723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.693621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:14.700510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:14.701462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:14.702248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:14.705419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 114/224] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:14.717848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:14.757663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:14.817855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 111/225] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:14.853936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:14.855330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbe7ca-5c2f-4b4f-9b11-5b2fb51a1689 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:14.890527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:14.891137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:14.891414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:14.891684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:14.892346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:14.892677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:14.894107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:14.907854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 115/226] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:14.908758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.008984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:15.018121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08311e-6d86-437a-89ec-6ad679e20d46 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.087703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.088252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.088553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.088825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.091378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.092856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.095367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:15.104102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.126640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4826d-80ad-4308-b30e-c6b109ab6a1c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.146079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:15.167622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.168267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.168582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.168858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.180796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:15.186139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:15.187005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:15.187804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 112/228] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:15.193249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.296057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664bb7f-768b-4a26-8909-e4ff1588b13a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.331618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.332244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.332630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.332916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.334032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.336282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.338071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 117/229] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:15 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:15.343663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.380937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:15.431222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe45fc-7e69-4fcb-84c0-be35c31937a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.451519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f264c-9fc8-43ff-a3f5-e42861c6d4da None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.490694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.491624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.492176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.493282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/f67070df89694bdd81364aa040f4e7c9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.495425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, user_id=f67070df89694bdd81364aa040f4e7c9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.497164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.505173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.505798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.506280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.506824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.507697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:15.508150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.509703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.512446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 118/230] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:15 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/f67070df89694bdd81364aa040f4e7c9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:15.527745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:15.533580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.658142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:15.679649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f9d8-e026-46c3-8870-fc35b07fee6d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.733831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.734841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.735374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.735854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.741841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.743693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.746015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 119/232] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:15 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:15.752024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:15.803869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:15.879888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20485a5-bf1a-44f5-938e-050404b2d25c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:15.917718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:15.918300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:15.918704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:15.918980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:15.920207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:15.921725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008918a5-f9b0-4e85-9734-6d82b87bd6f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:15.923424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 114/233] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:15 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:15.930466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:16.063300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dafd5c-09da-4da8-a7fb-72d32e4e4e71 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:16.111105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:16.111776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.112168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.112450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/f67070df89694bdd81364aa040f4e7c9/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.114725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, user_id=f67070df89694bdd81364aa040f4e7c9, role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:16.116808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180253a0-31bc-4dd8-ba72-c9ef523c1e58 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:16.139600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:15 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/f67070df89694bdd81364aa040f4e7c9/roles/19aab39ee8c04f399191428b85e73932 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:16.291450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd3cb-2130-41ff-ac4d-edaf2de02948 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.292146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd3cb-2130-41ff-ac4d-edaf2de02948 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.292722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd3cb-2130-41ff-ac4d-edaf2de02948 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.294916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 115/235] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:16.301225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.301733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.301808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.330183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:16.331405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:16.336594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:16.419968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 121/236] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:16.444703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd3cb-2130-41ff-ac4d-edaf2de02948 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:16.562363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd3cb-2130-41ff-ac4d-edaf2de02948 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:16.569797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:16.597880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:16.598529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.598814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.599089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.611754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-293b815d-a2ac-45e5-b293-313d493625cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:16.617112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:16.618094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:16.618967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 116/237] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:16.625006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:16.787812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9f9f1-c114-4a5e-b5d6-e9d5715d050c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:16.829211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:16.829759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.830037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.830309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.830992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:16.831298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:16.832694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:16.844584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5ce5-ebcf-4a2c-9831-1a86d3836839 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.845067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5ce5-ebcf-4a2c-9831-1a86d3836839 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.845141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5ce5-ebcf-4a2c-9831-1a86d3836839 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.846690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 117/238] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:16.847725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 122/239] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:16.853198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d73e2-2117-4d19-a9f0-752fce367f95 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:16.853485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d73e2-2117-4d19-a9f0-752fce367f95 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:16.853759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d73e2-2117-4d19-a9f0-752fce367f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:16.859240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:16.865488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:16.891035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-753d73e2-2117-4d19-a9f0-752fce367f95 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:16.892267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-753d73e2-2117-4d19-a9f0-752fce367f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:17.025946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057e1f3-eabf-46d5-81d2-4defe4397767 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.065000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 118/240] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:17.085552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.086111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.086398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.086674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] PATH_INFO: `/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.106239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] RBAC: Authorizing `identity:get_user(user_id=15e1be5c26614ddfa1c5ee10db43ac5d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:17.107775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:17.114333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 123/241] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:16 2022] GET /identity/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:17.117151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889fda-126b-4f2b-a721-47445d2be00b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.117670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889fda-126b-4f2b-a721-47445d2be00b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.118140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41889fda-126b-4f2b-a721-47445d2be00b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.119694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 119/242] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:17.122526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.130565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41889fda-126b-4f2b-a721-47445d2be00b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.200760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.247527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e035b-017d-40b1-abf6-44cf8ce6c466 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.249826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.258966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41889fda-126b-4f2b-a721-47445d2be00b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.291199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.292238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.293041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.293802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.298147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.298298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.298658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.299002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.300177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:17.301777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e1271-425d-4f95-97c4-db5b35183f95 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:17.308463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 120/243] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:17.308463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.308463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.308463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.325928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:17.327414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:17.377450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:17.379522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:17.414068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 121/244] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:17.415240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.470465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.528640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 124/245] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:17.530140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.539134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.548202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe06d5-4c6a-4280-8bc6-e649288b19f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.586419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.587496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.588066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.588562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.589424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:17.591273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:17.618221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 122/246] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:17 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:17.619516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.677457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a06a-17fc-4957-b6c3-782a398d4721 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.754664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1d9d-85e5-4d00-ad80-f821ac9a7e71 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.773985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.774657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.774951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.775278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.797628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.798937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.799438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.799924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.801436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:17.803167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:17.805386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:17.806838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 123/247] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:17.811630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:17.812534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:17.813338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 125/248] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:17.815339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.821579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:17.839569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.859650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:17.948644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e343c1-227a-451c-b2a9-e6f86cc735da None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.973199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879acb70-c7a4-4326-ae39-649b167898cb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:17.995009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:17.996326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:17.996835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:17.997304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:17.998326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=15e1be5c26614ddfa1c5ee10db43ac5d) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:17.998852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.001228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.009767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 124/249] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/role_assignments?user.id=15e1be5c26614ddfa1c5ee10db43ac5d&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d58ddb2305af400f85567a6c9c200990 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:18.029521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.030244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.030591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.030928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.031753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:18.032126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.033720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a8e75-caed-4eee-8bfe-23e75b4d13e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.045552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 126/250] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:18.051585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.141949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727abb-7a03-4615-b2f1-6574a7b421c9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.142303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727abb-7a03-4615-b2f1-6574a7b421c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.142495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8727abb-7a03-4615-b2f1-6574a7b421c9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.143998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 127/251] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:18.152431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.152794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.153026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.182363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:18.183596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:18.187316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:18.209435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027d73a-8caa-42f3-92b3-8de883101cd4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.248168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.249100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.249532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.249934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] PATH_INFO: `/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.251219 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ca1280dbf3459fb9b709b5d3122a7b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.252871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.254993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 125/252] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:18.262538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.282726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 128/253] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:18.310001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.328791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:18.378690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfacbd-1650-4c31-affb-c662e7eafe31 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.418381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.419029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.419331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.419595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.420777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.422454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.424504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 126/254] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:18.428202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53477761-3df2-4834-a7c4-9259db784a59 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.431024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.456889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:18.472647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.473249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.473478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.473814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.487295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:18.492452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:18.493377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:18.494192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 129/255] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:18.499765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.556157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bf3fe-7092-4dd1-a154-085d7f663089 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.594020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:18.601827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.602856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.603347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.603826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/a8ca1280dbf3459fb9b709b5d3122a7b/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.606145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, user_id=a8ca1280dbf3459fb9b709b5d3122a7b, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.607840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.632094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 127/256] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:18 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/a8ca1280dbf3459fb9b709b5d3122a7b/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:18.636865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6b2dd-4056-40ed-b5c5-f91e53243bb2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.692434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.693090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.693433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.693712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.694952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:18.695257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.696855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92751a71-1064-4737-8618-e4a5c8205779 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.707077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 130/257] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:18.713728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.731609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5f09-f2e1-4bca-b26e-ecd45db0382e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.731800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5f09-f2e1-4bca-b26e-ecd45db0382e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.732074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5f09-f2e1-4bca-b26e-ecd45db0382e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.733696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 131/258] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:18.738883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.739154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.739437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.759131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:18.760371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:18.833074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 132/259] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:18.847556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:18.869622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.875867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcef87-f164-4cd2-b234-3d1282ebdbf4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:18.943633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:18.945293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:18.945781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:18.946287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:18.947705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:18.949712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:18.952704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 128/260] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:18.958379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:18.989409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.082833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddfe82-3446-4c60-853a-58beaa8ccdc9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.108463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdb49-18fe-467e-8f0c-7b087126a155 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.164445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.165550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.165934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.166287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.175393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.176384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.176818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.177303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.204290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:19.210328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:19.211557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:19.212745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:19.213517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:19.214105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 133/261] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:19.224832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:19.339264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.340970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:19.402775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8db68-f12b-4cef-980a-05bfe55dd32c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.427849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.439514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.440915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.441394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.441861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.442726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:19.443248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.445674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:19.455061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 134/262] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:19.461457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:19.461787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 129/263] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:19.469101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:19.520231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.578307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab81c86-c562-47f5-be75-9fa6a0654e81 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.581774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1550-ff82-4003-a326-3500be75eca2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.620121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.620720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.620997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.621270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.622554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.623337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.623993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:19.624405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.624900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.625363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] PATH_INFO: `/v3/users/f67070df89694bdd81364aa040f4e7c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.625826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 130/264] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:19 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:19.632176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:19.633178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] RBAC: Authorizing `identity:get_user(user_id=f67070df89694bdd81364aa040f4e7c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.634837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:19.636867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 135/265] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:19 2022] GET /identity/v3/users/f67070df89694bdd81364aa040f4e7c9 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:19.642456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:19.733947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.744819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb732-930e-4ca3-a7de-64a41dce5900 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.764051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:19.783560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cce1d-379e-43c2-9323-1cbb60939095 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:19.808370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.809009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.809288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.809566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.810286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=f67070df89694bdd81364aa040f4e7c9) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:19.810587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.812146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:19.827273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 131/266] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:19 2022] GET /identity/v3/role_assignments?user.id=f67070df89694bdd81364aa040f4e7c9&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:19.833096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:19.834136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:19.834621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:19.835700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:19.935343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:19.937223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:20.020513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:20.078853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 136/267] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:49:20.084119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:20.212219 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b913cd-1bc9-411b-b84c-8e3cd343d8b4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:20.260119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:20.261152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:20.261634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:20.262101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:20.265421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:20.267116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9653e-5d07-4f44-ab00-1051cfd7334a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:20.269013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 132/268] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:20 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:20.275655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:20.391169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f14b3-afab-48b2-84bd-2bc7fe00b1b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:20.444569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:20.446135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:20.446615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:20.447234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:20.448264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=f67070df89694bdd81364aa040f4e7c9) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:20.448807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:20.450724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aca3d-7f99-4d7f-9f12-45e99ab4a6ba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:20.457959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 137/269] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:20 2022] GET /identity/v3/role_assignments?user.id=f67070df89694bdd81364aa040f4e7c9&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=19aab39ee8c04f399191428b85e73932 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:20.914802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8deba-bf49-400a-8c91-111e1608950c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:20.915491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8deba-bf49-400a-8c91-111e1608950c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:20.915986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8deba-bf49-400a-8c91-111e1608950c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:20.917820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 133/270] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:20.923201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:20.923720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:20.924208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:20.943270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:20.944940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:20.959402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.016929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 138/271] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:21.039798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8deba-bf49-400a-8c91-111e1608950c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.089945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.149043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8deba-bf49-400a-8c91-111e1608950c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.187981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.188697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.188977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.189248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.200128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5d2d6a9c-4418-41fa-9712-b07e4f982a3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:21.205299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:21.206158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:21.206926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 134/272] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:21.212268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.222010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1d20-5751-45a4-b187-cabd9e31ec5e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.222512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1d20-5751-45a4-b187-cabd9e31ec5e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.222985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1d20-5751-45a4-b187-cabd9e31ec5e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.224470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 135/273] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:21.231167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.231763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.232185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.252184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:21.253624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:21.324136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b728-0d8f-4c9c-8c39-464feaa0cf72 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.326910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 136/274] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:21.353344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.361093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.361693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.361969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.362241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.363416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:21.363721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.365119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.376301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 139/275] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.383253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.396213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.400103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.479399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecbf1c-8f3d-4659-830c-acc2841a8260 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.510748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588cff-8474-4dac-bc4a-3ea128fd08d7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.516141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.516809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.517092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.517365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.528640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-326a4acd-0886-4b7e-b6b5-b39ffbcb5b28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:21.533335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:21.534187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:21.535009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 137/276] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:21.536226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316f5b-8bfc-41b8-af98-e4918bfd0a1a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.536397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316f5b-8bfc-41b8-af98-e4918bfd0a1a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.536704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79316f5b-8bfc-41b8-af98-e4918bfd0a1a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.538679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 138/277] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:21.543300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79316f5b-8bfc-41b8-af98-e4918bfd0a1a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.552244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.552973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.553253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.554048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] PATH_INFO: `/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.555414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] RBAC: Authorizing `identity:get_user(user_id=15e1be5c26614ddfa1c5ee10db43ac5d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.556944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1ec82-8674-4370-82a8-c96484589eae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.562972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 140/278] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.562972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.562972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.562972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.579264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:21.580420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:21.649621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.655846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 141/279] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:21.657000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.657280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79316f5b-8bfc-41b8-af98-e4918bfd0a1a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.676814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.705667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.706264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.706542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.706809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.707472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:21.707770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.709171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.717227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 139/280] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.722401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.776894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a230e5-d12b-450c-ad74-4d05df6672c4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.813702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.814330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.814611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.814884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.816087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.817731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.823754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 142/281] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.823754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.826519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93b08-251f-4709-8382-65ac67bdb036 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.861084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.861712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.861993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.862264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.863366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.864843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1010-d65f-499f-916b-60dee09a7cc7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.867267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 140/282] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.868444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be5d5-9b9c-4f00-897e-9d5925099bc7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.868757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be5d5-9b9c-4f00-897e-9d5925099bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.869037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3be5d5-9b9c-4f00-897e-9d5925099bc7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.870372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 141/283] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:21.871259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be5d5-9b9c-4f00-897e-9d5925099bc7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:21.897686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.901275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:21.924896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227d56a-beb1-4e86-a01b-ab7bbd9d7624 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.959659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:21.960282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:21.960594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:21.960864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] PATH_INFO: `/v3/users/e5946b53002a45dfb569e78095d1a872` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:21.971603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3be5d5-9b9c-4f00-897e-9d5925099bc7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:21.973572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=e5946b53002a45dfb569e78095d1a872)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:21.975020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:21.977218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 143/284] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:21 2022] GET /identity/v3/users/e5946b53002a45dfb569e78095d1a872 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:21.981977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.009058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.009702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.009980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.010254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/15e1be5c26614ddfa1c5ee10db43ac5d/roles/d58ddb2305af400f85567a6c9c200990` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.012130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, user_id=15e1be5c26614ddfa1c5ee10db43ac5d, role_id=d58ddb2305af400f85567a6c9c200990)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.013596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb45bf8-6adc-4afd-8b82-bbe618942f2b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:22.026505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 142/285] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:49:21 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/users/15e1be5c26614ddfa1c5ee10db43ac5d/roles/d58ddb2305af400f85567a6c9c200990 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:22.027737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.027977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.028253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.056800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:22.058057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:22.093288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343b54c-62ce-4611-9791-8de4f6919fc0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.134853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.135468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.135747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.136017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.136699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.138162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:22.148810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 143/286] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:22.148810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.149400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:22.167660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:22.174304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 144/287] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:21 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:22.175805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.298438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5a6a-6c84-49e4-b7d9-c1214d8d1e37 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.327826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af712d-93db-4279-8439-2b11c729abe0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.341053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.341717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.341987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.342271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.343872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, user.id=e5946b53002a45dfb569e78095d1a872, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:22.344411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.346151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:22.352617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 144/288] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 10 16:49:22 2022] GET /identity/v3/role_assignments?user.id=e5946b53002a45dfb569e78095d1a872&scope.system=all&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:22.384129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.384846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.385128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.385402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.398810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:22.404135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:22.405124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:22.405907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 145/289] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:22.413560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.505998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:22.529169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec584-cd2d-41df-aafc-0c98afc6a086 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.569939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.570472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.570796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.571067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.571734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:22.572030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.573498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:22.583291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 145/290] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:22.589575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.643653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:22.707043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb55b-c5c9-428f-8920-9c370298bcb0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.744577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.745619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.746104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.746577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] PATH_INFO: `/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.747938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] RBAC: Authorizing `identity:get_user(user_id=a8ca1280dbf3459fb9b709b5d3122a7b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.749605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:22.751716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 146/291] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:22 2022] GET /identity/v3/users/a8ca1280dbf3459fb9b709b5d3122a7b => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:22.757471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:22.862702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333f00-fb49-4499-9d3a-f1bf2999353e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:22.904200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:22.905244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:22.905758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:22.906324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:22.923423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:22.980242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:22.981776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:23.105573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:23.113830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:23.288016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e581e-5fd3-4267-a6a7-73b0ad976e45 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:23.322098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:23.343821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:23.344460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:23.344767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:23.345227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:23.346796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:23.349058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8ffe5-06bd-474e-a340-90aaac446565 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:23.352667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 147/293] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:23 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:23.359912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:23.418471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:23.496515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fba29-25f5-4166-b3c2-988bb7390676 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:23.546768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:23.547388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:23.547671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:23.547945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:23.548705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=a8ca1280dbf3459fb9b709b5d3122a7b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:23.549081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:23.551230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b14a8-f78c-45ab-970b-bc0cd09c5101 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:23.559960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 147/294] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:23 2022] GET /identity/v3/role_assignments?user.id=a8ca1280dbf3459fb9b709b5d3122a7b&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:24.458182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b17b7-64ae-4a94-8b92-7988092846d4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:24.459035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b17b7-64ae-4a94-8b92-7988092846d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:24.459460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b17b7-64ae-4a94-8b92-7988092846d4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:24.462147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 148/295] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:24.467753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:24.468632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:24.469112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:24.488281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:24.489873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:24.561245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 148/296] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:24.585680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b17b7-64ae-4a94-8b92-7988092846d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:24.697185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b17b7-64ae-4a94-8b92-7988092846d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:24.733106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:24.733619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:24.733890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:24.734172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:24.745112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:24.750266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:24.751151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:24.751981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 149/297] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:24.757794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:24.792965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:24.858531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5458f-14fe-48eb-85a5-3be8c61ac375 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:24.894862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:24.895470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:24.895753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:24.896029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:24.896728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:24.897053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:24.899509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:24.908232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 149/298] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:24.913858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:24.965550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.019559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5007-02b4-4d91-8625-b878156d6bc2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.054950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.055580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.055865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.056137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] PATH_INFO: `/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.057337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] RBAC: Authorizing `identity:get_user(user_id=15e1be5c26614ddfa1c5ee10db43ac5d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.058785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066e1aa-c350-42bf-b1d1-d82cd1733cae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.060684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 150/299] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:24 2022] GET /identity/v3/users/15e1be5c26614ddfa1c5ee10db43ac5d => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:25.066336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.081910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec859-3e6f-4c6e-a326-d247f21f7c2f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.082234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec859-3e6f-4c6e-a326-d247f21f7c2f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.082462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec859-3e6f-4c6e-a326-d247f21f7c2f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.084111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 151/300] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:25.089835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9f61-49dd-4a14-abf9-f4bf81da71c7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.090061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9f61-49dd-4a14-abf9-f4bf81da71c7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.090327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f9f61-49dd-4a14-abf9-f4bf81da71c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.108722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-365f9f61-49dd-4a14-abf9-f4bf81da71c7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:25.109913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-365f9f61-49dd-4a14-abf9-f4bf81da71c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:25.175265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.179811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b905dc5-33fd-410e-a850-ca2f8885bb60 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.181536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 152/301] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:25.188705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ae3c-95cc-4d68-a48a-30a65b35b01b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.188888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ae3c-95cc-4d68-a48a-30a65b35b01b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.189135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152ae3c-95cc-4d68-a48a-30a65b35b01b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.195323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 153/302] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:25.196461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.196773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.197049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.216397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:25.217824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:25.218234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.218843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.219121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.219390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.259413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.287004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 154/303] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:25.288364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.290848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.292342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2704e-0e36-4d60-81e2-ea29ccb5566a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.386820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcfda1-9c49-4112-aa9b-9ab53523c64b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.388181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.393913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 150/304] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:25.395253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323949f0-cfed-4fc6-a96f-98f1d6e7ecc3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.395544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323949f0-cfed-4fc6-a96f-98f1d6e7ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.395815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323949f0-cfed-4fc6-a96f-98f1d6e7ecc3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.397137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 151/305] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:25.399071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323949f0-cfed-4fc6-a96f-98f1d6e7ecc3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.428034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.428796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.429300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.429792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.431807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.434611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.442075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 155/306] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:25.442075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.486033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.501101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323949f0-cfed-4fc6-a96f-98f1d6e7ecc3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.537496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.538798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.539262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.539536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.544353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fdd230-6fb2-41be-808d-330b1f0d118d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.549766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-96e2bd36-6556-465f-b27c-65aad21b42ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:25.555689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:25.556616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:25.557444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 152/307] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:25.558648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.558996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.559338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.577390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:25.578573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:25.583016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.583635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.583911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.584179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.585500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.586930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.588590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 156/308] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:25.589335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.631898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.645762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 153/309] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:25.646574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.703655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e2c4c-75ef-486e-bcc4-8d54e1dcb2af None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.714071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.738849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.739452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.739732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.740001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] PATH_INFO: `/v3/groups` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.740657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.742780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.750570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07baffd-6645-42eb-92f5-e371227f6ff4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.758388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 157/310] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 10 16:49:25 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:25.759397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.800331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.800900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.801176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.801448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.802134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:25.802436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.803890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.812854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 154/311] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:25.813742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.877027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:25.889102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b70e-18fc-4676-9ac5-bc18bf52b594 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.932879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:25.933501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:25.934059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:25.934338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:25.935231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, scope.project.id=f389ecc164cc41908dbbbda84fabaafb, user.id=15e1be5c26614ddfa1c5ee10db43ac5d) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:25.936222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:25.937649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:25.944904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 158/312] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/role_assignments?user.id=15e1be5c26614ddfa1c5ee10db43ac5d&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d58ddb2305af400f85567a6c9c200990 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:25.945715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:25.946740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eee680-234b-4e0f-8bf2-3942269b464e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:25.999086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.000011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.000294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.001079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.004750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:26.019459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:26.027437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:26.028630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:26.029587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 155/313] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:26.036641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:26.122316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c92f91-56eb-4b32-98d2-0df78ad2b038 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:26.167169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c099d-0fc1-44ff-95b5-10669e9f1a75 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:26.175010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.175791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.176167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.180820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] PATH_INFO: `/v3/users/e5946b53002a45dfb569e78095d1a872` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.180820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] RBAC: Authorizing `identity:get_user(user_id=e5946b53002a45dfb569e78095d1a872)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:26.180820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:26.181670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 159/314] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:25 2022] GET /identity/v3/users/e5946b53002a45dfb569e78095d1a872 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:26.182838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:26.188639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:26.215194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.215951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.216771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.217918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.218589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:26.219008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:26.220696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:26.230545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 156/315] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:26.236707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:26.323746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70dbd0-42ca-43f9-97a0-d58f1885a334 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:26.325722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:26.363941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.364841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.365248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.365633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] PATH_INFO: `/v3/system/users/e5946b53002a45dfb569e78095d1a872/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.368904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e5946b53002a45dfb569e78095d1a872, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:26.370259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:26.371009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee62e7-cc7a-4e5d-87bc-e75e1e0d3d7a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:26.379691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 160/316] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 10 16:49:26 2022] PUT /identity/v3/system/users/e5946b53002a45dfb569e78095d1a872/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:26.410362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.411179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.411560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.411962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] PATH_INFO: `/v3/users/a6354fde2904429b8f7ba4acd98d476e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.430669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] RBAC: Authorizing `identity:get_user(user_id=a6354fde2904429b8f7ba4acd98d476e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:26.432427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb206751-4193-49bd-bf89-245ba9a6ec28 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:26.439324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 157/317] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:26 2022] GET /identity/v3/users/a6354fde2904429b8f7ba4acd98d476e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:26.441287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:26.573657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5578-3455-4823-b7ff-9cb4cdca8fdf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:26.613474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:26.614089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:26.614376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:26.614643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:26.615389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, user.id=a6354fde2904429b8f7ba4acd98d476e, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:26.615695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:26.617449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216849-2c11-490e-bffe-00164a48de89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:26.632601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 161/318] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 10 16:49:26 2022] GET /identity/v3/role_assignments?user.id=a6354fde2904429b8f7ba4acd98d476e&scope.system=all&role.id=d58ddb2305af400f85567a6c9c200990 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:28.099754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438fec-bdef-4c77-ba51-13139529d850 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.101198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438fec-bdef-4c77-ba51-13139529d850 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.101198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438fec-bdef-4c77-ba51-13139529d850 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.102605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 158/319] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:28.108194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.108675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.108825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.127575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:28.128790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:28.154820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:28.202307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 162/320] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:28.226261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438fec-bdef-4c77-ba51-13139529d850 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:28.257948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:28.337665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438fec-bdef-4c77-ba51-13139529d850 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:28.372548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:28.373109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.373392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.373781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.374888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:28.376327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334db1-be85-4289-9415-cf543c39af2b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:28.378123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 159/321] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:28.384790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:28.495976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdf12d-725a-474e-b93b-efad7c67f534 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:28.533988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:28.534616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.534895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.535167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] PATH_INFO: `/v3/groups` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.535801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:28.537271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c45016-f6cd-46d0-89bb-e841397a3965 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:28.555576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 163/322] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 10 16:49:28 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:28.564422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548852-6c6d-4abe-be55-af1d60d143ef None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.564862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548852-6c6d-4abe-be55-af1d60d143ef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.565208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548852-6c6d-4abe-be55-af1d60d143ef None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.566906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 160/323] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:28.573144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3067e-d65e-4d63-8134-4ef967de8181 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.573502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3067e-d65e-4d63-8134-4ef967de8181 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.573699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3067e-d65e-4d63-8134-4ef967de8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.593601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2ee3067e-d65e-4d63-8134-4ef967de8181 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:28.594810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2ee3067e-d65e-4d63-8134-4ef967de8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:28.612439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:28.682683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 164/324] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:28.703856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5548852-6c6d-4abe-be55-af1d60d143ef None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:28.795417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d245d-0858-46c5-9b28-072587fb5e96 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.795722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d245d-0858-46c5-9b28-072587fb5e96 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.796051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d245d-0858-46c5-9b28-072587fb5e96 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.797346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 165/325] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:28.802298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.802581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.802850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.813099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:28.818617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5548852-6c6d-4abe-be55-af1d60d143ef None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:28.824824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:28.826003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:28.865321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:28.865966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:28.867033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:28.867033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:28.880739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:28.885632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:28.886565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:28.887773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 161/326] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:28.893504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:28.926633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 166/327] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:28.951282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.032120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6133d-115c-4742-a8d1-dad098dcedd2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.059479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:29.082399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.083170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.083617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.083894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.085476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:29.086049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.087614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.090500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ef7a1-d040-4699-92f9-0522e5bd50fb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.098819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 162/328] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:29.105848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.134520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.135164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.135422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.135695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.137985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:29.148808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:29.153577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:29.154466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:29.155270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 167/329] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:29.160519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.241962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3df8a5-5067-49fd-8fc6-d5739c14321e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.291641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.292547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.293029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.293397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] PATH_INFO: `/v3/users/e5946b53002a45dfb569e78095d1a872` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.295104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] RBAC: Authorizing `identity:get_user(user_id=e5946b53002a45dfb569e78095d1a872)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.296959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.297644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41185281-afd1-46ee-ad03-c50843e3a90c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.298896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 163/330] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:29 2022] GET /identity/v3/users/e5946b53002a45dfb569e78095d1a872 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:29.305324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.338867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.339927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.340464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.340771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.341439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:29.341742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.343114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.354402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 168/331] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:29.359886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.362684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:29.410131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:29.424941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb0e10-5212-48fd-8998-6c1abd1b0ada None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.480185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.480843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.481130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.481405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.482325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] RBAC: Adding query filter params (role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, user.id=e5946b53002a45dfb569e78095d1a872, scope.system=all) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:29.482640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.484270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.502507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2143-be20-4c61-ae23-5910e1b60742 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.505734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 164/332] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 10 16:49:29 2022] GET /identity/v3/role_assignments?user.id=e5946b53002a45dfb569e78095d1a872&scope.system=all&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:29.544552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.545199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.545474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.545746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] PATH_INFO: `/v3/users/a6354fde2904429b8f7ba4acd98d476e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.546948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a6354fde2904429b8f7ba4acd98d476e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.548443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ced4-c36e-4453-9633-3914214d43f3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.550247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 169/333] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:29 2022] GET /identity/v3/users/a6354fde2904429b8f7ba4acd98d476e => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:29.557446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:29.675921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d13606-d1cc-4fbf-a84a-4bb8f88ffe0c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:29.714322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:29.714994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:29.715280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:29.715558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] PATH_INFO: `/v3/system/users/a6354fde2904429b8f7ba4acd98d476e/roles/d58ddb2305af400f85567a6c9c200990` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:29.717076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6354fde2904429b8f7ba4acd98d476e, role_id=d58ddb2305af400f85567a6c9c200990)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:29.718464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9573-c184-4333-996c-57bbaa81585e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:29.731571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 165/334] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 10 16:49:29 2022] PUT /identity/v3/system/users/a6354fde2904429b8f7ba4acd98d476e/roles/d58ddb2305af400f85567a6c9c200990 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:31.363211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb932b9-da1f-4f0c-8be1-7c5b019bc3ed None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:31.363723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb932b9-da1f-4f0c-8be1-7c5b019bc3ed None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:31.363802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb932b9-da1f-4f0c-8be1-7c5b019bc3ed None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:31.365426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 170/335] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:31.371121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ee7a-df66-44c7-8c92-12e9b9079f5c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:31.371617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ee7a-df66-44c7-8c92-12e9b9079f5c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:31.371695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343ee7a-df66-44c7-8c92-12e9b9079f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:31.395666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d343ee7a-df66-44c7-8c92-12e9b9079f5c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:31.397611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d343ee7a-df66-44c7-8c92-12e9b9079f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:31.400902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:31.487476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 166/336] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:31.490269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1c1b-e989-4e67-b1f7-978b4bf2f302 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:31.490558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1c1b-e989-4e67-b1f7-978b4bf2f302 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:31.491026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d1c1b-e989-4e67-b1f7-978b4bf2f302 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:31.492359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 171/337] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:31.497916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:31.498203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:31.498481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:31.521510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:31.523272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:31.525880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1c1b-e989-4e67-b1f7-978b4bf2f302 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:31.632238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 167/338] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:31.677546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:31.677875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:31.751046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d1c1b-e989-4e67-b1f7-978b4bf2f302 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:31.855406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:31.885747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:31.886687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:31.887136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:31.887572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:31.918286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:31.928176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:31.929304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:31.930104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:31.931181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 172/339] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:31.951110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:31.967983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f044c62-b608-4f17-9aef-f9c0f46d4ca8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.076427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.077509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.078182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.078815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.106608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:32.112342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:32.113474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:32.114481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:32.116839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 168/340] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:32.123287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:32.224341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db05595-c962-4f6a-b731-962a671c1f34 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.257144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:32.278187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.278921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.279212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.279481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.280161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:32.280457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:32.281956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:32.298143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 173/341] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:32.303776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:32.346135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4853ae-52bf-48cb-8edf-aaa1b89b7573 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.408207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:32.425530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.426481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.426928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.427356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.428463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:32.429009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:32.431231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00ec5-58b1-447a-bd3e-5e03a62759f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.431664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c680e-8d36-41ed-83bf-54742e696e89 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:32.452963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 169/342] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:32.455319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdad52-6a67-47dd-8ea4-657a45e1efa7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.455943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdad52-6a67-47dd-8ea4-657a45e1efa7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.456576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdad52-6a67-47dd-8ea4-657a45e1efa7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.458919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 170/343] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:32.460313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdad52-6a67-47dd-8ea4-657a45e1efa7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:32.476706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.477058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.477437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.477717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.547215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:32.555884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:32.560388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c442b9d-734d-4265-b5be-32caee7d054e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:32.649050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdad52-6a67-47dd-8ea4-657a45e1efa7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.669420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 174/344] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:49:32.669420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.674394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.674626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.697541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:32.698728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:32.701617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.702401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.702690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.702961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.783690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:32.794511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:32.796127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:32.800866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 175/345] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:32.801798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:32.838119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:32.936439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366d718-70cf-48b5-bfb1-82caf1cc827f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:32.960300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 171/346] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:32.961512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:32.976003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:32.976719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:32.976984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:32.977296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:32.978488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:32.979978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:32.984257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 176/347] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:32.985164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.086868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.097404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f842b21-781a-4588-b9fa-8ce70052c311 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.114563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.133042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260c07-4608-4179-a229-5be98d505b5b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.147989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.148979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.149482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.149963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.153203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.154849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.157903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 177/348] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.159613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.202726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.203742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.204777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.205389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.227716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:33.233587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:33.234466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:33.235339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:33.238644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 172/349] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:33.239734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.377327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ccd40-36b0-4be8-853e-8b4d32640f6d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.420969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8989933-aac0-4789-b5e3-474b33ad6b41 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.423843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.424737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.425093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.425461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.434382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.434382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.437439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 178/350] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.438133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.471451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.472193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.472473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.472773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.473978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.475859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c581619-45fb-4bc3-b2cb-c52d69c6becf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.476518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.477657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 173/351] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.480910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967d1b-e954-4e15-86b1-50965f023825 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.480910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967d1b-e954-4e15-86b1-50965f023825 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.480910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967d1b-e954-4e15-86b1-50965f023825 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.481259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 174/352] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:33.481670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef967d1b-e954-4e15-86b1-50965f023825 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.517496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.584981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba793-fc1d-4c12-9b13-6bfd04a7d080 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.632686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.633088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.633375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.635342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.636082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:33.636395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.637857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75271a3-039b-4a06-a8fe-504531d10714 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.638927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef967d1b-e954-4e15-86b1-50965f023825 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.650145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 179/353] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.653175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c1c7-d201-4c1f-987f-9669f619417e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.653175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c1c7-d201-4c1f-987f-9669f619417e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.653175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099c1c7-d201-4c1f-987f-9669f619417e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.653385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 180/354] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:33.654282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.654569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.654848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.681485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:33.682820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:33.707588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.708202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.708497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.708770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.710871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=fd84e43ba49e48038d55d63483289724) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:33.711300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.712680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.722011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 175/355] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.722719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.775646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 181/356] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:33.776576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:33.794575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.877987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:33.903689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559781a7-fba2-46a3-8fa7-9ca98a2da781 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.908295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c853a-5b5e-4d2d-8eb5-40c7b19b269e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:33.949225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.950460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.950963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.951440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.952244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:33.952397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=fd84e43ba49e48038d55d63483289724) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:33.952668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:33.952912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.953191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.953461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.954034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dac6c-147f-4ace-8a19-d2b6251775d2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:33.961472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 176/357] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=19aab39ee8c04f399191428b85e73932 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:33.962619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:33.962902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:33.963173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:33.998744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:34.000187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:34.064295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:34.066138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67b06-cc0f-4179-b899-1ee696c6212d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:34.088611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.107964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 177/358] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:34.109077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.244077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.244249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 182/359] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:34.250537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcb81-548b-4117-93d4-f692bb8a12f6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.250835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcb81-548b-4117-93d4-f692bb8a12f6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.251151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dcb81-548b-4117-93d4-f692bb8a12f6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.252599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 183/360] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:34.253345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dcb81-548b-4117-93d4-f692bb8a12f6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.277626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca78fcf-8532-46fd-ba05-03b5a0856a28 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.327018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.327692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.328139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.328420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.343726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:34.350873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:34.353373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:34.354465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 178/361] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:34.357832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.407063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dcb81-548b-4117-93d4-f692bb8a12f6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.423730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.452644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.453433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.453779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.454117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.469652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ea091440-6650-49d5-8ef9-d72ca6511c4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:34.474857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:34.476819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:34.478253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 184/362] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:34.479956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.479956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.480238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.501996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7278-bf12-4d9f-b530-7eb49002a226 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.502630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:34.503734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:34.546447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.547098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.547382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.547774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.549218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:34.550816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:34.552845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 179/363] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:34.554205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.563839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.620716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 185/364] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:34.629460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.679843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c632e-e159-4201-a1d0-e2343c1c28eb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.733791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.734650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.734935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.735207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.736505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:34.736846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:34.738783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:34.751175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 180/365] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:34.752124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.781674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda4c51-4156-40ce-9a85-1c364bbf28f4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.785344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.846794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.847190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:34.847447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.847733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.848043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.849417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:34.849732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:34.852619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:34.866762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 186/366] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:34.867339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:34.893454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9598dc-b4e2-4e5b-8eff-6538d7867ae6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:34.939361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:34.940261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:34.941293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:34.941731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:34.943273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:34.946611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:34.949762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 181/367] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:34.951026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.008321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1cec3-9bfd-4ba0-ae7b-21534c7d49a3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.052448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.053935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.054312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.054684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.067794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:35.075385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:35.076505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:35.077311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:35.077916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 187/368] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:35.078702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.087685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec0a2d-b738-4178-90a4-b430a67d1470 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.116622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.135242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.136206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.137089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.137576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.142864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.220409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25bd7-8823-4660-811e-dc02fbdfad9e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.241726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.243849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.264258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.265268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.265766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.266245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] PATH_INFO: `/v3/users/a6354fde2904429b8f7ba4acd98d476e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.267624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a6354fde2904429b8f7ba4acd98d476e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.269311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.271173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 188/369] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/users/a6354fde2904429b8f7ba4acd98d476e => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.272265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.373678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 182/370] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:35.374787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.386952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.399693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6838e3-d2b1-42b5-be3a-76c0d91436a0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.417450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.438744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.439756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.440261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.440782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.441728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=f389ecc164cc41908dbbbda84fabaafb) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:35.442237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.443898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.450300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 189/371] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.451469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.493671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f735c-500f-48af-b5bc-31c4db4e4617 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.533169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.533794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.533794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.533794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.534488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:35.534787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.536174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.546556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 183/372] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.547427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.573027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ea296-6dc5-408d-a308-f915783f7fe6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.612749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.613761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.614271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.614753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.616687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] RBAC: Adding query filter params (role.id=d58ddb2305af400f85567a6c9c200990, user.id=a6354fde2904429b8f7ba4acd98d476e, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:35.617205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.618858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.633122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 190/373] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/role_assignments?user.id=a6354fde2904429b8f7ba4acd98d476e&scope.system=all&role.id=d58ddb2305af400f85567a6c9c200990 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.634307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.660513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.661919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f3cf-371b-4280-9f81-f214e1c5ca3e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.672260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.701316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862625-f865-4428-8496-d097706372f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.702021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862625-f865-4428-8496-d097706372f2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.702257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862625-f865-4428-8496-d097706372f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.702531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862625-f865-4428-8496-d097706372f2 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.704307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862625-f865-4428-8496-d097706372f2 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.705310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862625-f865-4428-8496-d097706372f2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.707419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 184/374] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.713744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862625-f865-4428-8496-d097706372f2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.781681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929fbb-1617-44ba-9ba9-4ed60d52875f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.821817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.822686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.823117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.823551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.837499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862625-f865-4428-8496-d097706372f2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:35.878156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:35.878951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:35.879402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:35.879995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:35.881741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.883493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.885702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 185/375] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:35.891406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:35.906285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:35.908001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:35.932592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:35.950347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:36.023450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 191/376] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:36.031797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428a104-ef6f-4ef0-ba37-f266f76e203a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:36.031973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:36.074428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:36.076663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.077331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.078380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.079369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=f389ecc164cc41908dbbbda84fabaafb) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:36.079969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:36.082204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:36.099721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 186/377] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:35 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=19aab39ee8c04f399191428b85e73932 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:36.199165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11667264-7f86-46d6-9f92-4fbdc6cd46e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:36.224742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:36.246415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:36.247063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.247342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.247614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] PATH_INFO: `/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.250653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] RBAC: Authorizing `identity:get_project(project_id=cac92c6a1cc54a05870dbe2cd79f672b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:36.252134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:36.254286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 192/378] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:36 2022] GET /identity/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:36.260440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:36.399587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:36.403717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c1430-ab1b-4c00-a661-ee5cf77c5f5a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:36.444020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:36.444994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.445286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.445563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] PATH_INFO: `/v3/groups/4093b721a8194163942396d8bcec905a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.453620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] RBAC: Authorizing `identity:get_group(group_id=4093b721a8194163942396d8bcec905a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:36.455158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75bec2-d14e-4033-995e-4f496d8071f1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:36.457215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 187/379] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:36 2022] GET /identity/v3/groups/4093b721a8194163942396d8bcec905a => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:36.463675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:36.585416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c846-edad-4002-9bfc-69fd40726094 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:36.587223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f76d-50e2-481a-9c17-a9d6ce6126e8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.587629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f76d-50e2-481a-9c17-a9d6ce6126e8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.587824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0f76d-50e2-481a-9c17-a9d6ce6126e8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.589269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 188/380] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:36.596516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.596516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.596516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.632714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:36.633931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:36.639834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:36.640444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.640750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.641023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.641761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] RBAC: Adding query filter params (group.id=4093b721a8194163942396d8bcec905a, role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=cac92c6a1cc54a05870dbe2cd79f672b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:36.642072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:36.643496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bc805-922c-41c4-b04e-4960539d53dc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:36.661180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 193/381] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:36 2022] GET /identity/v3/role_assignments?group.id=4093b721a8194163942396d8bcec905a&scope.project.id=cac92c6a1cc54a05870dbe2cd79f672b&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:36.735018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f63f-d6c0-4fdb-8826-b92bc19dcccb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.735361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f63f-d6c0-4fdb-8826-b92bc19dcccb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.735561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f63f-d6c0-4fdb-8826-b92bc19dcccb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.740679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 194/382] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:36.753349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:36.753674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:36.753946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:36.754781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 189/383] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:36.781440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:36.782655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:36.791436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:36.867953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:36.901700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 195/384] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:36.932370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:36.962317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:36.978625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce380e-fdf7-42ca-8a20-e0ff1acd682a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.034615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.036299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.037104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.037661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.052810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:37.060638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:37.061549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:37.062360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:37.065505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 190/385] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:37.072294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.102917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76956a4a-2e56-4b36-afed-2d95d8d32e10 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.201299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd977-1f04-4f2f-8261-6bf3c96fbff7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.206011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.206681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.206958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.207225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.241939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:37.244116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.245018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.245494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.245972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.246854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:37.246968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:37.247773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:37.253192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 196/386] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:37.254634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.257060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.270443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 191/387] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:37.270795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.275526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.300185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:37.397585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:37.399849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb5da7-9c0d-4ff4-b4e3-9cea3f978f9a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.437507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.438581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.439072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.439575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.440915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.442699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.446595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 192/388] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:37.452706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.548217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:37.560425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754adda-ff30-424b-85a8-b38b5df0d051 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.569896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b0fe-8c2d-4f49-b3d9-94921dd6559c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.608495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.609927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.610422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.610887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.612431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.614205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.617068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 193/389] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:37.627680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.645218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.645878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.646129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.646410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.647325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:37.647698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.649117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.663813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 197/390] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:37.685719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.752264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ce642-59b5-47ec-a796-ab2f979e17bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.791736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.792588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.792968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.793345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/groups/8255771880a74331ba243d7d890bab45/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.795562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, group_id=8255771880a74331ba243d7d890bab45, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.797264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.801001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:37.804767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2a6be-514d-438a-8332-e0266797b460 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:37.817765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 194/391] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 10 16:49:37 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/groups/8255771880a74331ba243d7d890bab45/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:37.845302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:37.846112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:37.846498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:37.846878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:37.848267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:37.849940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:37.852033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 198/392] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:37.857390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:37.897522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:37.977004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be68fdd-63c8-4f05-ba6b-e37d2a0f5234 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:38.017016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:38.017681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:38.017975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:38.018254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:38.019467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:38.020977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658196f-6b92-4a3e-865d-253d8e401e79 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:38.023696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 195/393] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:37 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:38.029576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:38.140278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf56f8-6cd2-4da1-a6e4-26b4e87d28a3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:38.176614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:38.177277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:38.177560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:38.177838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724/groups/8255771880a74331ba243d7d890bab45/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:38.180396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd84e43ba49e48038d55d63483289724, group_id=8255771880a74331ba243d7d890bab45, role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:38.182018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cdac5-795f-4daa-a80f-e676f03b6597 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:38.204454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 199/394] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 10 16:49:38 2022] PUT /identity/v3/projects/fd84e43ba49e48038d55d63483289724/groups/8255771880a74331ba243d7d890bab45/roles/19aab39ee8c04f399191428b85e73932 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:38.578272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a7e9-cbfd-43c7-acc8-a77d5ed3df7e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:38.578676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a7e9-cbfd-43c7-acc8-a77d5ed3df7e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:38.578885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a7e9-cbfd-43c7-acc8-a77d5ed3df7e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:38.580535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 196/395] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:38.586659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:38.586947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:38.587229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:38.613570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:38.614811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:38.648331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:38.710227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 200/396] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:38.747449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a7e9-cbfd-43c7-acc8-a77d5ed3df7e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:38.850765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:38.881693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a7e9-cbfd-43c7-acc8-a77d5ed3df7e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:38.938664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:38.939316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:38.939600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:38.939875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:38.956420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7a785b1b-9176-4683-988e-89287636a802 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:38.962666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:38.963586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:38.964461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 197/397] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:38.970346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.015252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc637-f6d9-44e6-8ebb-dc41ce8fd448 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.015571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc637-f6d9-44e6-8ebb-dc41ce8fd448 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.015812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddc637-f6d9-44e6-8ebb-dc41ce8fd448 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.017466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 198/398] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:39.022900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.023251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.023442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.064399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:39.065888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:39.111981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca01e7-a283-4e19-9e1b-9e5d3fb4a78b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.152740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.153815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.154298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.154784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.155690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:39.156195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:39.157849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:39.167809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 201/399] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:39.174052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.198764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:39.225848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 199/400] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:39.261563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.287090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7317e-952a-42d3-96ea-9ecd251a09a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.325389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.326025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.326309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.326587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.327744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:39.329219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:39.331118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 202/401] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:39.337424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.426209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:39.437142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:39.446939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09740db-f3c6-40a1-bdc4-8c13c35c5c43 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.483716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.484362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.484699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.484976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.487206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:39.487907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef69c3-6716-4ecf-8dde-fad7eec905f4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.488712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:39.491365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 203/402] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:39.497503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.548810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.549876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.550350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.550813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.580679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:39.589986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:39.590910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:39.591709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 200/403] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:39.601453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.608508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f6a01-93ae-4299-ab28-f222171935fc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.649643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.650400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.650574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.650848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/groups/8255771880a74331ba243d7d890bab45/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.655382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, group_id=8255771880a74331ba243d7d890bab45, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:39.657089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f9ea2-d8b3-4762-9be4-f38db76c8414 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:39.680697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 204/404] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 10 16:49:39 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/groups/8255771880a74331ba243d7d890bab45/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:49:39.739594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d6c9-b7bc-4afc-995f-6f13874be41a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.739928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d6c9-b7bc-4afc-995f-6f13874be41a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.740149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d6c9-b7bc-4afc-995f-6f13874be41a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.742532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 205/405] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:39.748087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.748362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.748692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.774824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:39.776057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:39.800529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:39.807117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85094326-bd12-4a9d-958b-a279e2a2bbb0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:39.867739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:39.886951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:39.887831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:39.888467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:39.888916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:39.891017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:39.891704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:39.894524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:39.914510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 201/406] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:39.917631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 206/407] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:39.920156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:39.946359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.078966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a28e-1492-40cd-8720-01ed44d8fed5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.140093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421a5c-6cbe-4657-9be4-78af38890f45 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.156406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.157075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.157355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.157628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.159926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:40.161396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:40.168780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 202/408] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:40.172230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.216944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.217477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.217747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.218027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.231077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:40.235833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:40.236789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:40.237573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:40.239594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 207/409] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:40.247356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.263757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:40.292849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:40.361680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa19d6-bcae-4493-b0d8-36518bb9ecea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.432267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.432927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.433206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.433478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.435204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:40.436665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:40.440013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 203/410] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:40 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:40.443788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dc594-70a5-46ed-8899-9ad92dd20368 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.446610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.515713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.516237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.516533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.516805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.517474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:40.517773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:40.519143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:40.530567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 208/411] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:40.536287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.612432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71a63e-c920-4be5-b8a7-bab263848498 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.628985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:40.648221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:40.658486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.658992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.659276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.659548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb/groups/8255771880a74331ba243d7d890bab45/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.661762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] RBAC: Authorizing `identity:create_grant(project_id=f389ecc164cc41908dbbbda84fabaafb, group_id=8255771880a74331ba243d7d890bab45, role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:40.664251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530da2f-cd4a-4b32-9cef-863397786a5b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:40.688510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f32fde-d151-4c2f-955b-d1d97a6ff88b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.689021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 204/412] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 10 16:49:40 2022] PUT /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb/groups/8255771880a74331ba243d7d890bab45/roles/19aab39ee8c04f399191428b85e73932 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:40.689021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7280fc-89ef-4ab8-9afb-7a16f1c00639 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.689021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7280fc-89ef-4ab8-9afb-7a16f1c00639 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.689021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7280fc-89ef-4ab8-9afb-7a16f1c00639 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.689021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 205/413] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:40.707356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.707678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.707907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.736996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:40.738635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:40.796311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.796895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.797172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.797438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] PATH_INFO: `/v3/groups/4093b721a8194163942396d8bcec905a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.798767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] RBAC: Authorizing `identity:get_group(group_id=4093b721a8194163942396d8bcec905a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:40.800282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:40.802851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 209/414] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:40 2022] GET /identity/v3/groups/4093b721a8194163942396d8bcec905a => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:40.807691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.868286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 206/415] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:40.899648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:40.953928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0da5-2a8f-48bf-b96c-af1ac442523f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:40.996183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:40.996707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:40.996981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:40.997309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] PATH_INFO: `/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:40.998611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] RBAC: Authorizing `identity:get_project(project_id=cac92c6a1cc54a05870dbe2cd79f672b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.000212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb4a54-4159-42ae-9fe5-f2df00ffa777 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.002338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 210/416] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:40 2022] GET /identity/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:41.003693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f102bfb-bc12-4f8b-8f71-ffe17ee762d5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.003966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f102bfb-bc12-4f8b-8f71-ffe17ee762d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.004232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f102bfb-bc12-4f8b-8f71-ffe17ee762d5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.005911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 211/417] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:41.011724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f102bfb-bc12-4f8b-8f71-ffe17ee762d5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.017300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.023268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504fcf6-cf27-4ad5-8a90-e64280dea1d0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.044279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.065604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.066158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.066434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.066701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.079829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3e5647e0-cc1c-4858-898e-4b9caea428c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:41.085939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:41.086892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:41.087719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:41.091869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 207/418] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:41.093272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.093554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.093826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.114087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:41.115285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:41.160105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f102bfb-bc12-4f8b-8f71-ffe17ee762d5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.196185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.196929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.203303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.203303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] PATH_INFO: `/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b/groups/4093b721a8194163942396d8bcec905a/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.203303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] RBAC: Authorizing `identity:create_grant(project_id=cac92c6a1cc54a05870dbe2cd79f672b, group_id=4093b721a8194163942396d8bcec905a, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.203303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.204075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 208/419] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:41.205408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.220661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 212/420] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 10 16:49:41 2022] PUT /identity/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b/groups/4093b721a8194163942396d8bcec905a/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:49:41.244003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.338401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11eec-2d5d-48ea-85bd-409ccd6d406f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.339253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.348496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.385592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.386626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.387133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.387617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.388561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:41.389091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.390724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.395014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cf41c-c21d-48e2-b9df-fcf2e47ba1ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.401644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 209/421] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:41.407270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.440129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.440871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.441153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.441477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.454111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:41.459979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:41.461091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:41.462338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 213/422] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:41.468011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.531065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6ccff-9679-4418-b026-02b258ee0996 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.570440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.571448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.571941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.572417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.583477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3cb6cf-21cd-412f-9dcb-99fd9f03970d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.610811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.620009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.624582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.625466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.625895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.626403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.627303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:41.627909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.629525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.639619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 214/423] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:41.645535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.662180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.664176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.755927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0985-8b5c-41bf-a6d3-e784cfb3b24a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.779106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 210/424] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:49:41.789307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.793757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.794740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.795232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.795703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.855531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.869037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:41.870612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:41.872300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:41.902226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def752-167c-4448-821c-92e5bb4a0782 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:41.980823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 215/425] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:41.986697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:41.996200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:41.996888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:41.997169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:41.997441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:41.998773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.000350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.002112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 211/426] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:42.008331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.082754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:42.097393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41d647-3b6c-4e15-8ac4-3c798e7b8eba None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.158294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.158929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.159271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.159551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] PATH_INFO: `/v3/projects/fd84e43ba49e48038d55d63483289724` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.162149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] RBAC: Authorizing `identity:get_project(project_id=fd84e43ba49e48038d55d63483289724)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.164177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.166106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 216/427] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:41 2022] GET /identity/v3/projects/fd84e43ba49e48038d55d63483289724 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:42.172224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.211615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce07d1-fbe1-4040-9afc-cd1426af2ab1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.259106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.259779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.260317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.260628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.262544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.264738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4518ef-7d6c-4cf4-9764-2f80ea1c07c5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.267341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 212/428] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:42.268560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8bc8c-70c1-450c-a0cc-013969ca812d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.268846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8bc8c-70c1-450c-a0cc-013969ca812d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.269178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8bc8c-70c1-450c-a0cc-013969ca812d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.270409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 213/429] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:42.277533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8bc8c-70c1-450c-a0cc-013969ca812d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.283274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:42.328337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea974d4-4850-4289-b0f1-4232fdcd155c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.371884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.372537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.372819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.373093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.374219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.376101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0da8d-6ec6-4f6b-b8b6-f7bebb7928c1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.378434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 217/430] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:42.380317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.380626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.380902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.403787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:42.404701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8bc8c-70c1-450c-a0cc-013969ca812d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.405018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:42.426287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:42.450238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.451014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.451566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.451943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.452943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=fd84e43ba49e48038d55d63483289724) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:42.456743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.458888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.472505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 214/431] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:42.472505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.518545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 218/432] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:42.588063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:42.595362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.669742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba0c06-3d4f-475e-8277-c947b266ffdc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.710619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.711223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.711503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.711771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.712529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=fd84e43ba49e48038d55d63483289724) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:42.712843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:42.714393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:42.721038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 215/433] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=fd84e43ba49e48038d55d63483289724&role.id=19aab39ee8c04f399191428b85e73932 => generated 611 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:42.742803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37d743-4268-4892-86c9-a553daf7fb52 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.783217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:42.783871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:42.784115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:42.784322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:42.797875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:42.803796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:42.804800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:42.805609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 219/434] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:42.811453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:42.959774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acf468-f07c-40c1-8332-a3c64f114953 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:42.995960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.002190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.002806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.003082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.003352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.004022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:43.004325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.005734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb070c-f1c0-4b38-a6c5-678f57cc6eba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.016101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 216/435] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:43.022353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.042758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.140024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92ccb-8acc-425b-a923-34949f5ba568 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.180087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.181133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.181620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.182102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.189542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1bd1-0eb0-4155-9d81-a50759e79c2a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.189542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1bd1-0eb0-4155-9d81-a50759e79c2a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.189797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1bd1-0eb0-4155-9d81-a50759e79c2a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.191309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 217/436] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:43.197150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.197647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.198076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.219358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:43.220473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:43.272209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.274176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.292638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.317254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 218/437] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:43.341348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.417623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 220/438] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:43.422515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.467719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1185c-63ca-44c8-af15-6251f524541a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.498845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.511624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.512258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.512674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.512948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.524291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:43.529660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:43.530644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:43.531643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 219/439] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:43.536473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.542765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a919a-83c2-46f4-86f2-ff4eb232f898 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.558821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.584778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.585417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.585661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.585929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.587079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.588530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.590163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 221/440] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:43.595492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.654465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc1fff-4250-4f6b-afba-b723b6cf85eb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.696079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.696730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.697017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.697664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.697959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:43.698290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.700025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.708552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 220/441] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:43.711851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081a0b3-675e-4ece-846f-95cb204d1748 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.715413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.749891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.750557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.750838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.751111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.752610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.754046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.760831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 222/442] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:43.761874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:43.768258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.811672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:43.829067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985244a-0512-42e4-bb68-cbc98f62d884 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.861589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.862121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.862382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.862659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.865972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cded-755f-4dce-a8f4-33cc32fc8470 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:43.900194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:43.900828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.901112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.901388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.902113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=d8fc7d1921fd4f0981a9ce7cc51aee22, scope.project.id=f389ecc164cc41908dbbbda84fabaafb) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:43.902422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.903839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a383-c60b-4d61-8501-8756923aed89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.909699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 223/443] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:43.910861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8e26-5a2b-40ff-ba29-62f81c45c2da None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.911146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8e26-5a2b-40ff-ba29-62f81c45c2da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.911424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8e26-5a2b-40ff-ba29-62f81c45c2da None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.912726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 224/444] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:43.918467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:43.918759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:43.919039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:43.934488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:43.935985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:43.940133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:43.941450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:43.994930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.021000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 225/445] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:44.044542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.062224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 221/446] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:49:44.068289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.095804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.164189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db8bee-db00-40aa-834f-94ceee90d6c8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.186906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd43c9-1ca8-4887-a8fe-89c0d5e1c92b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.206698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.207484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.207769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.208043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.221416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:44.227852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:44.228902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:44.229723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 226/447] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:44.234524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.235072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.235172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.235431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.235705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] PATH_INFO: `/v3/projects/f389ecc164cc41908dbbbda84fabaafb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.236870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] RBAC: Authorizing `identity:get_project(project_id=f389ecc164cc41908dbbbda84fabaafb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.238324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.239982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 222/448] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/projects/f389ecc164cc41908dbbbda84fabaafb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:44.248678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.268978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.354815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8d11-9458-49c2-a260-9beedc8bdf8a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.356377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.363328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59055d-911d-4826-9216-8b614f96ee95 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.390712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.391318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.391598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.391876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.392573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:44.392878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.394298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.397300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.397928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.398237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.398507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] PATH_INFO: `/v3/groups/8255771880a74331ba243d7d890bab45` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.399662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] RBAC: Authorizing `identity:get_group(group_id=8255771880a74331ba243d7d890bab45)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.401147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.402814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 227/449] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:44.402939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 223/450] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/groups/8255771880a74331ba243d7d890bab45 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:44.408141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.408268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.492136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.510271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7804bc-2d27-4d4e-b944-c88a180c1be7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.510958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5e15-61a0-4665-8953-dae4ca65ad12 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.546058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.546402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.546668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.546949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.547058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.547222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.547314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.547507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.548226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] RBAC: Adding query filter params (group.id=8255771880a74331ba243d7d890bab45, role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=f389ecc164cc41908dbbbda84fabaafb) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:44.548551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.549986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.556066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 224/451] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/role_assignments?group.id=8255771880a74331ba243d7d890bab45&scope.project.id=f389ecc164cc41908dbbbda84fabaafb&role.id=19aab39ee8c04f399191428b85e73932 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:44.580712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.622526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.623926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.731065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 228/452] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:44.736832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.842926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49ae68-e581-49d1-9094-4d15d0c417e1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:44.877821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:44.878359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:44.878640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:44.878914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] PATH_INFO: `/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:44.880043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] RBAC: Authorizing `identity:get_project(project_id=cac92c6a1cc54a05870dbe2cd79f672b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:44.881525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:44.883167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 225/453] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/projects/cac92c6a1cc54a05870dbe2cd79f672b => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:44.888936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:44.954005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:44.992451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7dc02-6861-4353-bebb-48462084c66a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:45.026708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:45.027327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:45.027609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:45.027881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] PATH_INFO: `/v3/groups/4093b721a8194163942396d8bcec905a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:45.029011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] RBAC: Authorizing `identity:get_group(group_id=4093b721a8194163942396d8bcec905a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:45.030447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5443b1-c207-4a76-b20e-8fa1886523c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:45.032023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 229/454] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 10 16:49:44 2022] GET /identity/v3/groups/4093b721a8194163942396d8bcec905a => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:45.038145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:45.054294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:45.138407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8add-fa4e-4d96-a563-8122cfc6e5de None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:45.171284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:45.171884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:45.172166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:45.172440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:45.173189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] RBAC: Adding query filter params (group.id=4093b721a8194163942396d8bcec905a, role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=cac92c6a1cc54a05870dbe2cd79f672b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:45.173493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:45.174919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b92d97-c944-40a9-8f0f-b5b95a5ef5b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:45.180716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 226/455] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 10 16:49:45 2022] GET /identity/v3/role_assignments?group.id=4093b721a8194163942396d8bcec905a&scope.project.id=cac92c6a1cc54a05870dbe2cd79f672b&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:47.551903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590a26-d91c-4a99-82ac-1d7b35c596a3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:47.552625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590a26-d91c-4a99-82ac-1d7b35c596a3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:47.552625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0590a26-d91c-4a99-82ac-1d7b35c596a3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:47.555262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 230/456] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:47.560996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7824-20a0-4bdf-a01b-8407d7490755 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:47.561883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7824-20a0-4bdf-a01b-8407d7490755 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:47.562384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7824-20a0-4bdf-a01b-8407d7490755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:47.586440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f3dd7824-20a0-4bdf-a01b-8407d7490755 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:47.587947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3dd7824-20a0-4bdf-a01b-8407d7490755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:47.672669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 227/457] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:47.708716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0590a26-d91c-4a99-82ac-1d7b35c596a3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:47.854289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0590a26-d91c-4a99-82ac-1d7b35c596a3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:47.875607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7689fe-2428-47a0-9126-a124656a6849 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:47.876236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7689fe-2428-47a0-9126-a124656a6849 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:47.876748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7689fe-2428-47a0-9126-a124656a6849 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:47.878564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 228/458] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:47.885837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686519-8d41-49a4-83f4-6fc721c9ecd0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:47.886401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686519-8d41-49a4-83f4-6fc721c9ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:47.886867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686519-8d41-49a4-83f4-6fc721c9ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:47.892526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:47.901749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:47.902718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:47.907453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:47.907951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:47.921311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-55686519-8d41-49a4-83f4-6fc721c9ecd0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:47.924088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-55686519-8d41-49a4-83f4-6fc721c9ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:47.929331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:47.929938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:47.930811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:47.954022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:47.954984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:47.955834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:47.955834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:47.955834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:47.965399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 231/459] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:47.966962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.040963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 229/460] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:48.042055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6bd4-cd8e-4a81-bbe8-920e34e03ee2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.042339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6bd4-cd8e-4a81-bbe8-920e34e03ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.042606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe6bd4-cd8e-4a81-bbe8-920e34e03ee2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.046092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 230/461] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:48.057414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.057913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.058339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.080504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:48.082086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:48.132365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb60c50-e9d2-41c8-8c97-4b144398074a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.160204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 231/462] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:48.161480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.183382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.184242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.184684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.185103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.185921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:48.186403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.188344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.212127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 232/463] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:48.217338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.268458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.272386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.311477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf38816-9633-4df2-b338-26e4fb93bc04 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.332287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a3da-e2d4-415a-96e6-a15da78cb5f5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.352787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.353671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.354134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.354599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.365812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.367755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.376926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.377895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.378425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.378945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:48.384892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:48.385981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:48.386989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:48.386989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:48.386989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:48.388507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 232/464] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:48.393690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.394393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.395525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:48.411497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:48.413647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:48.414627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:48.414627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:48.414627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:48.414627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 233/465] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:48.414627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.506679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7065c1-edb0-4a22-8f16-057bda725c56 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.513054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.519003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc37d7f-cef1-467d-9264-891139c6d9a7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.540929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.546327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.547282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.547886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.548378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.549374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.551214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.555726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.556447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.556769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.557043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.557695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:48.557999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.559377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.573582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 234/466] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:48.574446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.583780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 233/467] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:48 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:48.586060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.694170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f775d7-fe6a-4fc2-a6c4-66d5469f275e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.718373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28f289-6ea2-4747-a48c-d740a4e68f4f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.735755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.736391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.736709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.736990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.738216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:48.738216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.739472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5a02-0fd9-4ce9-bdc6-5595f894985f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.752965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 235/468] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:48.754320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58305b9-e02f-4edf-93d0-64a5727a86bf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.754552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58305b9-e02f-4edf-93d0-64a5727a86bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.754832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58305b9-e02f-4edf-93d0-64a5727a86bf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.756435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 236/469] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:48.758772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58305b9-e02f-4edf-93d0-64a5727a86bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.764434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.765487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.765973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.766444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.767358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.769238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe9d68-d0c4-4236-a9f8-cabec2ffcbba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.780293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.799361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 234/470] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:48 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:48.801463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.802075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.802713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.829323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:48.831343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:48.874566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:48.908672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58305b9-e02f-4edf-93d0-64a5727a86bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:48.946571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 235/471] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:48.958251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:48.958876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:48.959962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:48.960647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:48.960846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:48.962302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:48.984682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:48.989896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 237/472] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:48 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:49:49.121731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44dcb5-c4e0-474a-ac85-d70169aeaa6a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:49.169137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:49.170030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.170455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.170892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.183233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:49.185007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:49.202304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:49.203409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:49.204441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:49.204441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:49.204441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:49.206043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 236/473] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:49.212894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:49.298120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:49.331923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7920bc-d743-4a89-9c7b-8ae9cf0714ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:49.370875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:49.371879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.372376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.372867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.373715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:49.374215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:49.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402067e-9daa-4559-be82-7b38901a6378 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:49.389915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 238/474] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:49.395715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:49.418407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0762fa-85c2-44e4-ae2d-8f5ba7b9f7d2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.418931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0762fa-85c2-44e4-ae2d-8f5ba7b9f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.419354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0762fa-85c2-44e4-ae2d-8f5ba7b9f7d2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.420922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 239/475] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:49.422307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:49.426710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.427004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.427264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.452773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:49.452773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:49.518746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133c33f-96de-4b74-aa70-f7cc3a4635b7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:49.525528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 240/476] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:49.572897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:49.573527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.573789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:49.574211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.574211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.574975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:49.576435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:49.620030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 237/477] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:49 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:49.668934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:49.716908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46788b9-c9e8-4327-9bf2-f0688c8858ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:49.755943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:49.756735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:49.757128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:49.757408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:49.758087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:49.759475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:49.768023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 16:49:49.768023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 16:49:49.768023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [parameters: {'id': '26b1a3d15dad42ae941d745be459c9ff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 16:49:49.768023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Aug 10 16:49:49.786161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:49:49.787139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 16:49:49.788666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 16:49:49.790904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:49:49.793086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:49:49.794503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'id': '26b1a3d15dad42ae941d745be459c9ff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:49.801027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 16:49:49.803529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:49.807509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 241/478] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 10 16:49:49 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:49.807664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:49.947268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:49.983033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf9cdc-6e3c-4c81-b353-27479df09d39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:50.018367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:50.019010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:50.019293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:50.019568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:50.031389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-30d06002-c3de-45ed-9bd4-13963396b826 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:50.036631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:50.037716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:50.038626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 238/479] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:50.043942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:50.166560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1dc01-e931-44de-9061-229d8f6a4bda None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:50.196898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:50.206181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:50.207902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:50.208183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:50.208518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:50.209253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:50.209619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:50.211652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c2a1-0010-424a-8841-dc23beb1db61 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:50.220876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 242/480] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:51.373738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701913ab-a1ef-4965-8e32-1f9fcadc83a5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.374257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701913ab-a1ef-4965-8e32-1f9fcadc83a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.374257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701913ab-a1ef-4965-8e32-1f9fcadc83a5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.375833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 239/481] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:51.377870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9f98f-9984-461e-a4fe-8f6bfcd34582 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.378273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9f98f-9984-461e-a4fe-8f6bfcd34582 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.378444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9f98f-9984-461e-a4fe-8f6bfcd34582 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.379828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 243/482] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:51.385357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.385608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.385729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.385880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.385969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.386153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.406144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:51.407466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:51.413668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:51.414870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:51.515024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 244/483] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:51.520803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 240/484] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:51.539453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:51.557388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:51.661545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:51.730418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599f609-fb8b-41b0-ae8a-cb4071debc1b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:51.748429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56dabbe-6308-467d-b4a5-2f48bf5a6172 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:51.772615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:51.804289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:51.804962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.805242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.805513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.812838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:51.813471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.813751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.814021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.825093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:51.827332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:51.829819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:51.830696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:51.831495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 241/485] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:51.832223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:51.833034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:51.833822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 245/486] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:51.841341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:51.843541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:51.951485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ded794-41b9-4785-9e28-5991a4f376e5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:51.958164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a73ba-dec0-4ad2-8acb-bfce390414c6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:51.974433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:51.991995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:51.992639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:51.992918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:51.993191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:51.993959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:51.994262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:51.995644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8afa-3fd3-47ed-b4c2-5a12708176d4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.002384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.003188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.003625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.004040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.004916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:52.005367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.006999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578efc3-3aa0-42ee-8122-5f08f7674a4c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.009870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 242/487] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:52.011168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fa69-f578-4bf0-a833-bfc34ab4c7ce None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.011451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fa69-f578-4bf0-a833-bfc34ab4c7ce None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.011722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fa69-f578-4bf0-a833-bfc34ab4c7ce None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.017266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 243/488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:52.017266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91fa69-f578-4bf0-a833-bfc34ab4c7ce None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.022059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 246/489] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:52.023594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.024054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.024471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.043990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:52.045539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:52.084859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.122500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 247/490] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:52.123588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.129932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91fa69-f578-4bf0-a833-bfc34ab4c7ce None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.181850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.182462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.182740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.183012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.193892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.195356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:52.211033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:52.212091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:52.213091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:52.213091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:52.213091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:52.216845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 244/491] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:52.217806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.234662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5487a9b-70cf-403a-91f7-cd96b20709a5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.254600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.275443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.276344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.276791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.277218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.288225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.289743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:52.305904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:52.306848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:52.307707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:52.307707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:52.307707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:52.307707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 248/492] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:52.307929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.332358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e368-1340-4034-ab89-390f127fb07c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.339180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.372626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.373254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.374024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.374846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.388391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-00407e8b-51aa-4308-994b-4b53c83ed561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:52.394513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:52.395405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:52.397203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 245/493] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:52.397921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574417-0a82-4d20-88c2-a7be98750e5e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.398781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574417-0a82-4d20-88c2-a7be98750e5e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.399845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8574417-0a82-4d20-88c2-a7be98750e5e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.401456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 246/494] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:52.402129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8574417-0a82-4d20-88c2-a7be98750e5e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.426110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31c83c-f753-47f1-864a-90898028fde2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.463664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.464676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.465231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.465822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.466476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:52.466781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.468277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.486184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 249/495] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:52.486184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.503273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.512913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8574417-0a82-4d20-88c2-a7be98750e5e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.547008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.547622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.547906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.548203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.548868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:52.549174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.550582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aebb16-9064-476b-9d97-026fa2812182 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.564530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 247/496] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:52.564530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.564530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.564852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.580393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.582918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:52.584711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:52.602384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df315c41-1ee8-4c06-a2c8-a28a60de8830 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.640868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.641630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.641963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.642348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.643050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:52.643400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.644899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.655383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 250/497] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:52.656212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.658419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 248/498] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:52.659456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.762576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.776729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769530-db4b-447d-9d0c-9acd902723ce None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.781461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329ddf5-f8eb-4913-b9c5-4e38622c969b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.813560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.814181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.814458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.814725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.818337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.819557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.819833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.820096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.822865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.824404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.828554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.830139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:52.837924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:52.839028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:52.839936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 251/499] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:52.840542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.846744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:52.849369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:52.851007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 249/500] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:52.857168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:52.947954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb5835-94fd-4e43-917e-39f3d3002178 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.960662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb3de6-5f08-4765-b80d-29c207986961 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:52.982583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.983194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.983470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.983739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.995179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:52.995356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7d672-17c2-4027-b968-a941886408db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:52.995984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7d672-17c2-4027-b968-a941886408db None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:52.996268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7d672-17c2-4027-b968-a941886408db None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:52.996642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7d672-17c2-4027-b968-a941886408db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:52.996736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.007344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7d672-17c2-4027-b968-a941886408db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:53.011375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:53.012409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:53.013681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:53.013681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:53.013681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-dce7d672-17c2-4027-b968-a941886408db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:53.013871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:53.014659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:53.015444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:53.016041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 252/501] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:53.016041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.017768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 250/502] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:53.018606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7d672-17c2-4027-b968-a941886408db None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.022825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.072541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.119372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6072f-10b0-477a-b102-111d236f5d36 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.122771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7d672-17c2-4027-b968-a941886408db None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.153740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.154341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.154621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.154890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.155614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:53.155918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.156995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.157362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1943f6-6ba4-408a-b62c-5e680cf58add None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.157602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.157868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.158141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.158862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:53.159166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.160626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.194374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 253/503] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:53.199429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271d46-932a-4699-9e05-d9c2fe328297 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.199429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271d46-932a-4699-9e05-d9c2fe328297 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.199429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271d46-932a-4699-9e05-d9c2fe328297 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.199612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 251/504] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:53.199612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.200752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 254/505] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:53.202025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19271d46-932a-4699-9e05-d9c2fe328297 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.259899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.300877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac718d-96a5-4765-847f-16e12bee039d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.304117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19271d46-932a-4699-9e05-d9c2fe328297 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.318054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.337998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.338608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.338882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.339146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.339782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:53.340081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.341113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.341544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.341718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.341998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.342267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.342931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:53.343231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.344608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7a4fd-24c9-4d1a-ab96-7578d6441f52 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.352631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 252/506] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:53.353035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 255/507] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:53.354051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.354335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.354608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.357716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.373815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:53.375007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:53.441328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 256/508] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:53.441993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.466996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c906-b9d5-4131-bc9e-9e5a132da47f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.489616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.502515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.503318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.503594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.503862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.546820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4df379-152c-481d-ba40-27c05de2d545 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.555209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.573328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.575037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.582335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.582935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.583217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.583491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.652760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.654227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.676137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 253/509] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:53.677015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.703423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.761585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 257/510] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:53.766476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.770336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.788924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5e0b-403e-4a16-a2cc-e35d53ce30cc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.822428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.823004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.823258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.823588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.833639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.835877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:53.850894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:53.851807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:53.852670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:53.852670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:53.852670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:53.852670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 254/511] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:53.853257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.864310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724fae8-06be-40a2-ab73-68ca4e3890f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.898732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.899358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.899614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.899876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:53.907059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:53.908624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:53.920869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:53.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:53.922761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 258/512] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:53.923327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:53.930876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.957039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710482-40c9-49bb-a7a4-7c5b6a29261f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:53.989153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:53.992407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:53.993143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:53.993448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:53.993720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.004791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.006905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:54.020522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:54.022183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:54.023011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:54.023011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.023011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:54.023011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 255/513] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:54.023337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.029078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b9640-8e05-4e40-8027-fcb3d7517bff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.062473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.063092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.063370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.063847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.074982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.076355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:54.090681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:54.091605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:54.092450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:54.092450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.092450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:54.092450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 259/514] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:54.092711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.130921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990547d-ed33-43d4-b521-f25971078675 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.157996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.167939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.168589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.168869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.169138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.181259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.182707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:54.197235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:54.198145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:54.198974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:54.198974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:54.198974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:54.198974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 256/515] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:54.199200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.207609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff18e4-7269-4403-8382-202e81d53c65 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.225410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.246250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.247003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.247391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.247795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.248538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:54.248924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.250466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.269431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 260/516] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:54.270313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.308654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44556ce-72f3-4d96-9ffa-357adfca23fe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.342967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.343494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.343772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.344053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.344888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:54.345201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.346680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.367399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 257/517] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:54.368233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.382885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858515-76ac-44a4-a288-39d6b1d8cba2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.406761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.420447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.421071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.421350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.421622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.422277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:54.422667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.423948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.438339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 261/518] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:54.439434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.477176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6e8c-3f58-4059-9c27-57359f8b7009 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.482185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.513568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.514169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.514447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.514721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.515364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:54.515662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.517163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.529395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 258/519] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:54.530255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.547751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1759-6274-4f22-80e8-4733b54b4de4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.583608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.584777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.585054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.585325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.585965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:54.586275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.587639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.599281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 262/520] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:54.600684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.638258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.645281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec7a8d-a695-4fa8-ae98-f04cd9819f9f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.680689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.681337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.681620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.681895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.690604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.692067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.700400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:54.704042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:54.705037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:49:54.705943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:54.706479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2018c-dbb6-4db0-8523-318c48a680b9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.706548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 259/521] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:54.706548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.742048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.742646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.742923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.743191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.811173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.811738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4c3fa-473c-48b7-9576-847f08169692 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:54.812645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.846868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:54.847476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:54.847757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:54.848032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:54.848706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:54.850751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:54.877398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 260/522] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:49:54 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:49:54.877398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:54.902283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.924645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:54.936141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 263/523] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:54.936141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.013920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b7b58-7ca9-4bd7-96f5-1a9c7e4534d3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.060782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.061441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.062365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.062489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824824a-d9a8-4c75-9b52-fa011afe6170 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.062569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.070649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.072168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:49:55.087834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:55.088764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:55.089742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 261/524] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:55.090205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.110477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.111055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.111336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.111608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.118852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.120312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:49:55.132163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:55.133707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 264/525] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:55.135432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.180580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.207613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.218567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f052e9-9c68-45ed-bd8f-4e426c5cc254 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.256499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.257224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.257506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.257777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.258539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:55.258854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.260657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.266325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da2b07-70a3-42b7-8514-fdb5016d27ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.278896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 262/526] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:55.279572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.307979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.308659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.308939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.309226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.322093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.323556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:55.339326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:55.340337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:55.341545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:55.341545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:55.341545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:55.341545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 265/527] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:55.341545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.394960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2a249-ff78-4025-a638-ab8be2a9100a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.425717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.432187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.432823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.433101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.433398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.434062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:55.434415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.435796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.458623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 263/528] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:55.458826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd78f2-d895-43aa-bca4-cead97c86c58 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.458992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.471750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.500090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.500733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.500977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.501253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.501944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:55.502247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.503659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.522080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 266/529] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:55.523069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.571681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cebdd-0ac5-4570-809b-a0359c7a5f39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.609689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.610607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.611063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.611510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.627396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691644f-47e2-431a-b84e-4b02988f4ac0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.670455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.670977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.671257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.671529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.672180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:55.672502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.673861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.684365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.686972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 267/530] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:55.692143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.700966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.702431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.727633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.807292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4fa66-978a-4b28-99b2-338fd3e26380 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.811833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 264/531] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:55.812933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.845872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:55.846460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:55.846738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:55.847010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:55.847727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=530609a984b24349a028bcf07ae290ca) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:55.848033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:55.850044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:55.864658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 268/532] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/role_assignments?user.id=530609a984b24349a028bcf07ae290ca&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:55.864658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:55.943969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.964161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d145724-9f60-4ce3-8a13-c2eab3b5d3a2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:55.989252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:55.999833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2d96-9643-458b-93d6-07816daee59f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.011770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.012610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.012987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.013408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.014272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:56.014674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.016792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.028981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 265/533] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:56.030073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:56.054868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.055488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.055772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.056049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.068135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.078119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:49:56.110229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:56.111160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:56.112012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 269/534] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:56.124632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:56.169927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934e41a-11a7-4a84-85f1-bc1b1e36a2bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.209836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.210814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.211316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.211808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.227454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.229294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:56.247060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:56.248037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:56.249305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:56.249305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:56.249305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:56.250807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 266/535] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:56.261507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:56.280508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:56.320609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eebc92-55d3-4679-914c-adf798df696f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.363842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.364602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.364895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.365213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.366058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:56.366435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.372508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.385272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 270/536] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:56.393857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:56.426436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:56.500688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb6b92-1369-4265-b479-3c24dd8f78e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.556202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.557197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.557684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.558156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.559027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:56.559554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.561181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.575288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 267/537] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:56.581289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:56.626573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9944c-8508-46ed-928d-a09d3ac765a1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.656099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:56.708592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.710347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.710873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.711345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.712279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fb66e8f0439d48fd9805921211801b65) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:56.713934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.715575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.728261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 271/538] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/role_assignments?user.id=fb66e8f0439d48fd9805921211801b65&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:56.734936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b195-4281-43c6-b54e-8efb7ebb0c90 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:56.810323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:56.811834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:56.812639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:56.813479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:56.830462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:56.833177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-10326d49-e887-4df8-ab69-019adbac04c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:49:56.853537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:56.854999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:56.855842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:56.858443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 268/539] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:56.864754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.001409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:57.028189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1c5-6d0d-47bc-a10e-678ac62db669 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.028886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1c5-6d0d-47bc-a10e-678ac62db669 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.029366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076a1c5-6d0d-47bc-a10e-678ac62db669 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.030522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcde73-62e9-4a63-8ec6-95f860b4d678 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:57.031511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 269/540] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:57.037679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.038242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.038719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.060017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:57.061795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:57.072665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:57.073322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.073603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.073875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.075118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:57.075232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:57.076635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:57.090845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 272/541] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:57.101016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.148058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 270/542] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:49:57.172024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.238844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:57.288117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf723c65-ced3-4a54-993a-c3a8c9c6e0f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:57.328333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:57.329347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.329860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.330337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.340191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c3d6-d530-4e24-850f-a8b73d565f89 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:57.342777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:57.347758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:57.348696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:57.350120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:57.356918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 271/543] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:57.359119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.390143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:57.390897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.391102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.391369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.392446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=faba61a963e149c3a09e17bed3c2ce46) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:57.392582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:57.393935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:57.401736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 273/544] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:49:57 2022] GET /identity/v3/role_assignments?user.id=faba61a963e149c3a09e17bed3c2ce46&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:57.510970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad13e-56e9-45b3-b0ac-65a3c215effe None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:57.532254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:57.554411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:57.555383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.555915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.556424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.557392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:57.557933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:57.559719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:57.570365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 272/545] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:57.577466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.585161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:57.787088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec323-0d61-4f58-84ee-e79b1960573b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:57.827896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:57.828550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:57.828828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:57.829097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:57.843266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:57.844697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:57.859687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:57.860670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:57.861516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:57.861516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:57.861516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:57.861516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 274/546] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:57.868046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:57.987903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577f87-0967-42b2-abac-b384fae2605b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:58.027001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:58.027974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.028458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.028959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.029824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:58.030334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:58.031899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:58.045263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 273/547] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:58.054291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:58.152346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:58.230405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bd7b6-8b62-4d7b-9848-95c0d66ac58e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:58.290167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:58.290802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.291078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.291350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.301453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:58.303606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-cd1d8f35-3799-4924-bbeb-1d0bf007f1d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:58.319458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:58.320577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:58.321980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 275/548] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:49:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:58.329045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:58.386814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:58.416602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391c08-3ec4-4af1-a5b1-faf50ed71ff3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.416602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391c08-3ec4-4af1-a5b1-faf50ed71ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.416602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58391c08-3ec4-4af1-a5b1-faf50ed71ff3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.418266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 276/549] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:49:58.420406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.420801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.421215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.445811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:58.447115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:58.515880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc35fa-ecc9-4d51-9500-0872609b483b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:58.559326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 277/550] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:58.580642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:58.581256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.581703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.582188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.583488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:58.584646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:58.586085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:58.605708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 274/551] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:49:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:58.613693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:58.618445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:58.699466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:58.763077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:58.769623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730336fc-c99c-4096-93e1-11917a09d826 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:58.773745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee5d7e-0f5e-4373-8cd1-bb1b094df0ba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:58.810497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:58.811763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.812249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.812751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.822948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:58.823607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.823896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.824138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.839759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-19b14f85-b06e-4c7b-98a7-f9072c3ca1d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:58.846696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:58.847810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:58.848914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:58.851997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 275/552] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:49:58.857862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7087-333e-46fd-b0ff-e7d98d8f421b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:58.858322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7087-333e-46fd-b0ff-e7d98d8f421b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:58.858828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d7087-333e-46fd-b0ff-e7d98d8f421b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:58.860570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 276/553] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:58.862133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7087-333e-46fd-b0ff-e7d98d8f421b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:58.898331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:58.899889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78056bf-23ec-4eb4-bde1-cd26a17d454d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:58.949630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:58.989000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d7087-333e-46fd-b0ff-e7d98d8f421b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.016690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 278/554] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:49:59.018421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.018883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.019369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.031813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.032195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.032502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.032812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.033484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:59.033839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.035298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.045209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:59.046820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:59.049944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 277/555] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:49:59.051030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.074465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.125150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 279/556] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:59.126518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.172298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd291e-6873-4d7d-b92e-e64452a0dc7b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.205115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.217801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.218434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.218713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.218990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.234367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8dc71-3b1b-4193-9a54-2fbfd1248669 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.234671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.237035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:59.258904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:59.260033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:59.260942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:59.260942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:59.260942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:59.260942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 278/557] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:59.261164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.280409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.281446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.281989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.282470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.295470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.297301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:49:59.314096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:59.315594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:49:59.316504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:49:59.316504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:49:59.316504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:59.318708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 280/558] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:59.319760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.346081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.384070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83f72-7275-4ca9-9133-4f7bbb60bab3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.425719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.426362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.426647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.427111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.428659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2def3a-15ea-4b8a-969d-040af424b442 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.439774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:49:59.445688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:59.446620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:59.447526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 279/559] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:59.448929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.463260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.474098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.474771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.475057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.475335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.475989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:59.476295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.477709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f01b4-d6fc-4cc5-a869-48e0eaacc363 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.491145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 281/560] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:59.492374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc768-fd7e-48c6-a9ad-fd5fb40bcf9b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.492693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc768-fd7e-48c6-a9ad-fd5fb40bcf9b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.492965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fc768-fd7e-48c6-a9ad-fd5fb40bcf9b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.494975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 282/561] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:49:59.495694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc768-fd7e-48c6-a9ad-fd5fb40bcf9b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.569803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70dd35-45f0-47e7-bebf-2a187a06cb4f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.602071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.607964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fc768-fd7e-48c6-a9ad-fd5fb40bcf9b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.612235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.612888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.613174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.613447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.614089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:59.614453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.616213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.633978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 280/562] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:59.633978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.649549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.655467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.655756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.656024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.656738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:49:59.657048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.658417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094933e-d15b-4a08-8eda-17981dbb08c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.668141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 283/563] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:49:59.669473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.669757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.670030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.692280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:49:59.694401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:49:59.745618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.753954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7135-a1df-41ab-ab32-1f0ccac52e35 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.780505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 284/564] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:49:59.780505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.815016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.815648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.815930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.816205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.823399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.825153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:49:59.837145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:59.838254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:49:59.839167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 281/565] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:59.839653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.889734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed530581-cea3-4bb6-81f6-73b30c4f5a4d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.894736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:49:59.929704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.930524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.930806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.931075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:49:59.938669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:49:59.940116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:49:59.949691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe463459-bfbe-4de1-8970-b326f1a5d6bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:49:59.953164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:49:59.954301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 285/566] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:49:59.955325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:49:59.991951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:49:59.992694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:49:59.992908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:49:59.993184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.000630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.004736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.006996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:00.022750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:00.023745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:00.025070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:00.025070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.025070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:00.025070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 282/567] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:00.025070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.071062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0195d-a0f7-4175-ac50-64c923b4b970 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.106349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.106973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.107242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.107507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.118018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:00.123071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:00.124060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 286/568] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:00.124980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.134872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad93b79-cae3-40e6-9343-a21ab4423449 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.136834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.175031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113861-a167-4775-b7d5-34297656119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.175636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113861-a167-4775-b7d5-34297656119f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.175919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113861-a167-4775-b7d5-34297656119f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.176230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11113861-a167-4775-b7d5-34297656119f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.176958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113861-a167-4775-b7d5-34297656119f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.177229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113861-a167-4775-b7d5-34297656119f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.179324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11113861-a167-4775-b7d5-34297656119f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.191038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 283/569] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:00.191843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113861-a167-4775-b7d5-34297656119f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.226188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.230078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29c19-ea05-4801-bbf7-853793dc1229 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.265880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.266392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.266665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.266938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.267657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.267982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.269425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eda394-b1ea-412d-9547-ff8df67a422f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 287/570] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f23f7-6418-4934-a556-319f493f216a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f23f7-6418-4934-a556-319f493f216a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f23f7-6418-4934-a556-319f493f216a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 288/571] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:00.292468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f23f7-6418-4934-a556-319f493f216a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.300279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11113861-a167-4775-b7d5-34297656119f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.337037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.337644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.337927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.338202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.338841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.339146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.340560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.353006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 284/572] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:00.353664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.378984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.400804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f23f7-6418-4934-a556-319f493f216a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.437709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.438312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.438590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.438866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.439524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.439825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.441204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.451435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 289/573] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:00.452262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.465048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0fe8-2f54-4db4-9563-29f9e9e40de2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.470748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.499883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.500485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.500792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.501065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.501785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=11327e8df21f49039aab8222a571f1fa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.502088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.503511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478867f5-5e2f-4d19-a59f-928e390f150d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.509989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 285/574] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/role_assignments?user.id=11327e8df21f49039aab8222a571f1fa&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:00.511228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.511364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.511561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.531759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:00.532971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:00.562514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef97e3-9be0-4471-b270-6f93026b9e26 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.602415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.603060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.603344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.603620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.624507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 286/575] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:00.624507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.624814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.624814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:00.634706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:00.635728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:00.636666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:00.636666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.636666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:00.640580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 290/576] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:00.641543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.649771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.726198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.756431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea684082-22b4-4719-bc7e-768505b92a4e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.766154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b14e0-1bed-4917-8c1e-2d4d40e8a99f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.794648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.795510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.795788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.796058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.802046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.802781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.803156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.803352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.804291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.805898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.814898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.816333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:00.817817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:00.819885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 287/577] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:00.821551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:00.840342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:00.841380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:00.842269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:00.842269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:00.842269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:00.842269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 291/578] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:00.842269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:00.916011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.942902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d745-00d2-4977-a67b-96a3ccad4c60 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.950694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe232f1-fe04-403b-8405-6a0e72721d3a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:00.978415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:00.980664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.981288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.981795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.982070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.982696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:00.982996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:00.984358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:00.993716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:00.994497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:00.994610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:00.994854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:00.998177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 288/579] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.001556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.005977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:01.011346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:01.012298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 292/580] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:01.013474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.121920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a080c-5be4-4863-8021-1e2c4af2b1c0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.132866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222227de-046b-4c0b-945e-3b2d3858f280 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.160076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.161118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.161398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.161599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.162833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.163198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.164849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.172212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.172850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.173139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.173411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.174140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.174447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.175908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.182149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 293/581] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.182149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.184762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.205497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 289/582] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:50:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.205497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.230794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.293264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0a3b3-dad8-4962-becb-1c4f4a3d02ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.325097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d1a72-080d-4249-81a6-357df59cb49a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.336678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.337309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.337598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.337868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.345171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.346627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:01.360053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:01.361250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:01.362468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:01.366274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 294/583] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:01.367110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.368173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.368825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.369105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.369376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.370255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.370556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.372932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.384157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 290/584] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.384920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.473790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.512267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70645-5a70-44fd-841f-3fbd1e1a0f15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.514819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.543869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc0e91-b986-4cfa-a8e7-378262cff851 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.571629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.572631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.573097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.573521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.587154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.589747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.594609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.595578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.596023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.596465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:01.610678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:01.611653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:01.612631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 295/585] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:01.613241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.622874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.625456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:01.648435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:01.649648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:01.650558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:01.650558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:01.650558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:01.657744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 291/586] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:01.659003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.743209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf1202-5736-4cf5-9685-653f83e4c411 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.770027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a73f6-8960-4268-9a0c-1f31ab8c84bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.778469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.779075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.779349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.779622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.779718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.780317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.780651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.782067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.794392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 296/587] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.799689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.806778 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.807404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.807682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.807951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.820095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.821569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.825560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:01.835965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:01.836956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:01.837845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:01.837845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:01.837845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:01.837845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 292/588] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:01.837845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.911927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1680b2-b63a-45e8-a031-5b40f2ced178 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.946965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d1626-f644-4719-bf14-6331b8dc5cc2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:01.949188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.950145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.950425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.950695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.951420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.951943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:01.953176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:01.971161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 297/589] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:01.971949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:01.994028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:01.995363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:01.995912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:01.996365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:01.997343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:01.997835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.000236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.018466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 293/590] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:02.019946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.045765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.073850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.093312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74f9d5-5e0c-4bc5-9a5d-66bc7bb2ef0a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.131640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.132298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.132608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.132738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8947-a63a-49a2-8570-48e177631f10 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.132925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.150164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=ca316ae3b4d84309af586fbb5aa61dd7, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.151618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.166329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 298/591] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:01 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:02.167489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.175993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.178652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.179266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.179723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.181501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:02.182015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.184559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.204750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 294/592] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:02.206681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.306833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6b73-ba01-4fb1-bef0-bdfe3b1cde22 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.309839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.333672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1864e3-4523-42fc-88ef-7d509c59852e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.340745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.347713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.348568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.348986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.349865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.361763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.363287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.376211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.376865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.377141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.377413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:02.381166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:02.382093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:02.382977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:02.382977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:02.382977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:02.385089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.386550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.387076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 299/593] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:02.388044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:02.398561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:02.399666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:02.400818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 295/594] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:02.405399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.508356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261c9c-593f-4e43-9421-229924edadf2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.515158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21fd21-fc30-4079-b94f-c4ad55b78ce8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.551827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.553026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.553307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.553581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.554316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:02.554611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.555646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.555976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.556334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.556646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.556924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.565216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.566372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.568614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.569874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 296/595] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:02.571035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:02.588132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:02.589338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:50:02.590497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:02.592801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 300/596] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:02.593755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.644326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.705352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1517f8-3989-4897-8540-45fbd87c55c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.714011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17b191-a8ab-4dff-b448-390382788f95 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.747813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.748425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.748743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.749015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.749714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:02.750018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.751472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.754988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.756995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.757339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.757705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.772826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 297/597] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:02.773086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.773241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.773388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ab996d42-b528-4a1d-9704-285dc30cb400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:02.784997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:02.786672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:02.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 301/598] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:02.788808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf652b7-9bc5-4c66-86e2-4f8619335f24 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.788935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf652b7-9bc5-4c66-86e2-4f8619335f24 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.789202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf652b7-9bc5-4c66-86e2-4f8619335f24 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.790559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 302/599] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:02.793237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf652b7-9bc5-4c66-86e2-4f8619335f24 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.847933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.893588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f72784-142a-4518-adb9-a0bf9b1730fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.908907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf652b7-9bc5-4c66-86e2-4f8619335f24 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:02.912413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:02.934298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.935057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.935445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.935718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.936437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:02.936762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.938178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:02.952306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:02.954110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:02.954826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:02.955253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/530609a984b24349a028bcf07ae290ca/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:02.956540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 298/600] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:02.957458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:02.978643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=530609a984b24349a028bcf07ae290ca, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:02.980075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527b07c-d0b1-44db-966f-fc608c45d0f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.004515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 303/601] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:02 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/530609a984b24349a028bcf07ae290ca/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:03.004515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.004515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.004515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.023373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:03.024974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:03.096397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754437-b5c0-430a-a257-9b600b775f34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.122767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:03.135711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 304/602] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:03.136977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.160812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.161587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.163376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.163749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.165150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:03.165150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.174069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.192171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 299/603] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:03.193695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.258938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:03.285061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e99f9-dde5-4655-82c0-530cdd8449fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.332585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.333471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.334841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.335898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.339339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b80a0e-cbab-426f-ad65-40ffef5b86bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.349071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.352318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:03.374789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:03.375801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:03.376756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:03.376756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:03.376756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:03.378546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 305/604] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:03.379521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.394807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.395600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.396575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.397638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.409330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:03.416016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:03.417264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:03.418337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:03.424790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 300/605] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:03.425867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.471381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:03.501580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b32f97-059a-446d-a62b-63c089f24634 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.539760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.540713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.541142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.541582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fb66e8f0439d48fd9805921211801b65/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.544243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:03.548962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7ba0-93b2-4c40-83f5-931620b23d92 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.558951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=fb66e8f0439d48fd9805921211801b65, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.560645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.584063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 306/606] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:03 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fb66e8f0439d48fd9805921211801b65/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:03.584063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.605994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.606763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.607594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.607715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.609353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:03.610306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.612050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.644768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 301/607] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:03.645943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.801138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c0944-969d-424d-be02-36f07c911dbf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.820166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:03.826387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53057b4-a2f8-4625-8c00-7c4d8d64cc8a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:03.840642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.841205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.841451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.841726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.842395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:03.842697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.844060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.852826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 307/608] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:03.858421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.870614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:03.871631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:03.872210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:03.872731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:03.881541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:03.883409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:03.898425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:03.899458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:03.900331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:03.902942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 302/609] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:03.910128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:03.924642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.029360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684540aa-5556-479f-be3b-522fe0c637a3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.100133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322fd7a-8552-4a50-8e51-2a5c5e06ad8b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.101931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.102691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.103071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.103448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.126478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.128083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:04.153827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:04.155007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:04.156060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:04.156060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:04.156060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:04.156060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 308/610] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:04.162637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.163132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.163517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.163890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.164281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.165156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:04.165785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.181073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.202835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 303/611] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:04.210895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.267254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.278140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.283564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ac00-bda2-4880-9ae8-c8e821395bd7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.321515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.322450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.322874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.323286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.324072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:04.324536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.326370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5921b-3b0c-414b-a11f-8fd6a6054507 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.339932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 309/612] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:04.345912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669ef65-f791-445e-a7d2-d77e3a59aa65 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.346366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669ef65-f791-445e-a7d2-d77e3a59aa65 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.346789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669ef65-f791-445e-a7d2-d77e3a59aa65 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.348225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 310/613] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:04.350255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669ef65-f791-445e-a7d2-d77e3a59aa65 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.361099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82406ff6-1609-400f-a21d-53c4ffca835c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.398227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.398889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.399174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.399452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/faba61a963e149c3a09e17bed3c2ce46/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.415173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=faba61a963e149c3a09e17bed3c2ce46, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.416812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcba3b-cb73-414f-81a5-8aac577db189 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.439494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 304/614] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:04 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/faba61a963e149c3a09e17bed3c2ce46/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:50:04.439494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.439494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.439494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.481840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:04.483616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:04.511661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669ef65-f791-445e-a7d2-d77e3a59aa65 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.592140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.593554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.594510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.595567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.612926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.616912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.618806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.623187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 305/615] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:04.636415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:04.637606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:04.638776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:04.640529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 311/616] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:04.648631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.653566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.690440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.786187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a06c-4425-44f0-802b-f8f413b2a812 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.796437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8d47a-581a-4155-8ac0-4a3d8aec3a26 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:04.834916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.835544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.835820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.836088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.838416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:04.839654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:04.840091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:04.840533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:04.841734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:04.842287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:04.844617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:04.847159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:04.852492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:04.853670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:04.854711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:04.856082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 312/617] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:04.861794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.870764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 306/618] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:04.876386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:04.951618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:04.998690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4426ac-0c83-4267-b9e2-c89b1c0b7c08 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.013568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:05.043885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89fa13-47eb-4331-912a-3fd035bbd87d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.087902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.088542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.088813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.089087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.089764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:05.090069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.091437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.106020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 313/619] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:05.107655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.108313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.108625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.108899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.111771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.129798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.131716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:05.158865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:05.160035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:05.160962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:05.160962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:05.160962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:05.160962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 307/620] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:05.167712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.314547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dbdb-319a-4a59-93f7-a21a28949eaa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.319914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d007440-c37b-41fb-8628-f53e7d57d1ef None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.340218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:05.383132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.383690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.383973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.384240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.385425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.386039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.386378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.386653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.387537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:05.387839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.390427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.406169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:05.411201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.413008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.417978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 308/621] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:05.422526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:05.441759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:05.443509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:05.445002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:05.445002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:05.445002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:05.445974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 314/622] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:05.451524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.591281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972daec-79af-4cb1-a1ec-dc91ca239502 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.607497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d7c9-92de-4726-b172-1bf576276486 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.639859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.640704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.641090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.641474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.644002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.644634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.644911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.645182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.645830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:05.646725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.648588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11d53-b759-4ac4-aba1-c716f387769c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.651071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.652668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:05.665771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:05.667186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:05.668878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:05.669691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 315/623] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:05.672555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26237c-06a8-46b1-a55c-1f0bce4f76a6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.672801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 309/624] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:05.672895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26237c-06a8-46b1-a55c-1f0bce4f76a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.672895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26237c-06a8-46b1-a55c-1f0bce4f76a6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.674319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 316/625] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:05.675458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.685431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26237c-06a8-46b1-a55c-1f0bce4f76a6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:05.712291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:05.753499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:05.814031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18cfa5-5060-4e36-b0bb-3f0d2a87160e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.830705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26237c-06a8-46b1-a55c-1f0bce4f76a6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:05.859860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.860552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.860890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.861365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.873144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.874699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-556720e1-f1d7-4444-987d-556911f93b08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:05.890817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:05.892194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:05.893387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 310/626] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:05.894352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.894590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.894909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.896180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:05.897046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:05.897523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:05.898080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:05.899072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:05.899714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:05.901458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:05.916278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:05.917572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:05.923677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 317/627] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:05.923677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.040507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 311/628] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:06.040507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.056734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:06.104287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0964f00-de96-4017-98d4-fa9505d7a159 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:06.122197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:06.166527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:06.167187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.167537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.167885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.168723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:06.169083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:06.170616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:06.191800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 318/629] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:06.192447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.206292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3100d-3f5d-405b-86d2-afd084b10c43 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:06.251002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:06.251794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.252150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.252260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/11327e8df21f49039aab8222a571f1fa/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.276259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=11327e8df21f49039aab8222a571f1fa, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:06.278024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272ec1a-921d-45b8-a4a5-bf4d8dc80f14 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:06.304076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 312/630] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:06 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/11327e8df21f49039aab8222a571f1fa/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:06.306331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c58-9e16-4528-b665-6d473709a4f0 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.306899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c58-9e16-4528-b665-6d473709a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.307408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c58-9e16-4528-b665-6d473709a4f0 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.313436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 313/631] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:06.314686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153c58-9e16-4528-b665-6d473709a4f0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.341660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3434f-17c7-4305-95c8-d5dc17232770 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:06.392041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:06.392866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.393240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.393664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.408823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b1f191f7-d6e6-40ea-b6e3-6464b0dca891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:06.422423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:06.423913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 319/632] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:06.424906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.426226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.426226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.452545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:06.452545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:06.452875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:06.501287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:06.510673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55153c58-9e16-4528-b665-6d473709a4f0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:06.577573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:06.577863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 320/633] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:06.578767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.579233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.579430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.579893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.721381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:06.723327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab29677-ab92-47ad-a016-97658d56b5ba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:06.795038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715b855-d0d1-4895-b0c2-e7da5a9aea8e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:06.813755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:06.839539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:06.840159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.840436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.840738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.841418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:06.841699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:06.843070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:06.857547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 321/634] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:06.859311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.867655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 314/635] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:06.868957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8eb3-a8c5-4287-b2dd-6a94cfc7f856 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:06.869238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8eb3-a8c5-4287-b2dd-6a94cfc7f856 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:06.869508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f8eb3-a8c5-4287-b2dd-6a94cfc7f856 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:06.870733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 315/636] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:06.871593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f8eb3-a8c5-4287-b2dd-6a94cfc7f856 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:06.898670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.006832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4ece-626f-406d-8608-e8e329baed87 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.008457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f8eb3-a8c5-4287-b2dd-6a94cfc7f856 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.059484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.059727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.060117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.060279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.060404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.060508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.060814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.060963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.074243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:07.074477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.076077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:07.079643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:07.080611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:07.081607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 322/637] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:07.082707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-87379e32-c389-4276-a2e0-86a50d8b36cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:07.100317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:07.101548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:07.102536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:07.102536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.102536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:07.103610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 316/638] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:07.105777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.106172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.106625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.127904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:07.129185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:07.149603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.230673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 317/639] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:07.236550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.237498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.272004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e9fea-99ff-4c62-ad02-23d31d7330c6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.318725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.319737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.320024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.320299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.332670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.334817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:07.353771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:07.355212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:07.356441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:07.356441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.356441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:07.356693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 323/640] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:07.357496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.374455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5ad8-53c9-4161-b94c-dbac147268f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.420004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.421223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.421223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.421223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.421884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:07.422180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.423549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.437506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 318/641] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:07.438416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.457630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.500442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58444fee-40fe-4db5-bcdc-d9aa66d07fff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.558241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.559075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.559529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.559974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.560981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:07.561497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.563331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.565969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.585752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 324/642] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:07.586937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.610479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfae7f-52de-4b2c-8d2b-5c21911d4b94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.667537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.668365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.668919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.669314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.689289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:07.695289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:07.697532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:07.700391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:07.705476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 319/643] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:07.706661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.744357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25e3f-68eb-4e48-a6f4-fe9401d445a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.804683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.805786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.806345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.806948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.808121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:07.808847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.811351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.830773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.842789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 325/644] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:07.842789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.876950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f785-cd16-4896-a91c-bf0eb09b9ea4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:07.918039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:07.918611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:07.918888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:07.919185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:07.924837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:07.933153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:07.935290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:07.954309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:07.955373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:07.961312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:07.961312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:07.961312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:07.961312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 320/645] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:07.961312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:07.989476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b76425-695f-4805-bfff-cfcf32736ac5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.058553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.059622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.059992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.060421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.073941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.076690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:08.096140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:08.104979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 326/646] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:08.106087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.113307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5df3e-0147-4dd6-976a-f5426226622c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.149093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.165049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.166001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.166314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.166760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.167449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:08.167756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.169191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.185380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 321/647] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:08.186252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.259480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649ad24-30d0-468f-b666-d4ccf16dc897 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.276960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.302174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.303428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.303717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.304000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.313515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.314886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:08.329058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:08.330225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 327/648] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:08.331142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.361575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfad8b-3bb8-41de-a2a3-2dc88b96ff86 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.430158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.430771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.431049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.431314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.432586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:08.432887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.434695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.457909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 322/649] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:08.459414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.459873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38abe75f-e2d6-4e50-a903-7f121ebead46 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.500053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.500677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.501150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.501287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.501925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:08.502232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.503640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.513163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.526500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 328/650] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:08.527353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.576529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.589954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4741be-a0d7-4594-89a9-63bebfd085a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.634642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.635539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.635962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.636359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.654033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.654816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:08.673905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:08.675075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:08.676131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:08.676131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:08.676131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:08.676131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 323/651] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:08.676131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.698602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da654-b72a-4ae2-8724-d9890142e2a8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.750800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.751415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.751690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.751962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.752690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:08.753294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.754548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.770773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 329/652] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:08.772433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.807466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.811098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766cad-b215-4a98-a4bf-e0449b985f61 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.854681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.855395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.855736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.856077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.865695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:08.867737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7a5db74c-aa99-424d-8864-d6e307404bb9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:08.891563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:08.893577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 324/653] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2863-76a2-4775-91aa-fd9c128ef5e3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.895819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2863-76a2-4775-91aa-fd9c128ef5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.897309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2863-76a2-4775-91aa-fd9c128ef5e3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:08.897438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 325/654] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:08.898844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2863-76a2-4775-91aa-fd9c128ef5e3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:08.912630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:08.926137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17e26-069b-4729-8619-09cf253c6b43 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:08.973335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:08.973944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:08.974881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:08.975686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.040356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2863-76a2-4775-91aa-fd9c128ef5e3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.069087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.070532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.085562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.086176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.086972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.087242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.088386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:09.088386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.089592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.108245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 326/655] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:09.108959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.129937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.179640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.191039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 330/656] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:09.191975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.225743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a083583-b077-4415-a75a-fcd3f687ec20 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.262738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.263348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.263632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.263904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.264657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:09.264965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.266399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ded8eb-a846-4bc7-9d82-5f45d6b767a7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.272628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 327/657] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:09.273852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.274139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.274412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.294927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:09.296210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:09.329879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221747f3-9bcc-4db8-8d7e-edd7194dd487 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.374500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.375029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.375318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.375584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.376330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:09.376664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.378222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.384184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 328/658] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:09.385006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.404082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.416008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 331/659] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:09.417628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.479078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.524422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234070-20a9-4763-b7bd-482d945f8da6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.555455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f569-dcfa-44a3-9621-7e2a3d4ea78f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.564717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.565475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.565825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.566175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.574546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.576264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:09.588876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:09.589903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:09.591108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 329/660] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:09.593645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.600931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.601624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.602005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.602115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.613427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.614918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:09.632301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:09.633453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:09.634338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:09.634338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:09.634338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:09.634338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 332/661] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:09.634338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.699000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.734102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e47c4f-dcc6-487f-a2a6-03a55dad8672 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.756640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90770271-62c2-403f-9ab8-6be2bc585b7e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.757696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.775531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.776261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.776666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.777008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.789282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:09.794582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:09.795614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 330/662] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:09.796588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:09.802614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.803317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.803605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.803886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.884704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.886097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.917262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a821879-105a-4093-9a78-eb63398abed1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:09.951782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:09.958221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:09.959470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:09.959607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:09.959913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:09.960683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:09.960980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:09.962546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:09.988184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 331/663] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:09.988184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.007092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 333/664] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:10.007976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.010531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.117809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1646-9ed6-43d7-82c1-336391823207 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.129788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e35ca-bdb2-450e-85ed-98ec959ee8fe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.158710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.159384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.159785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.160063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.160745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:10.161049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.162921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.169392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.169997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.170276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.170548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.171502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:10.171806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.173243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.176527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 332/665] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:10.182764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.183355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 334/666] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:10.184520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.248055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.270243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.310091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938633d-8b8e-4607-88d3-101d5f971462 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.312502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40373dfa-5732-4eb4-8229-d0f371e68e18 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.360050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.361042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.361162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.361731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.362008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.362234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.362342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.362817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.375410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.376411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:10.394847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:10.396598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:10.398076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:10.398076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.398076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:10.398076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 335/667] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:10.398557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.457061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.459782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.518907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.528809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c6df-e706-4b4b-b5bf-e97a7605a3ae None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.548997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.573535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.574176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.574454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.574747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.582844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.583375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 333/668] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:10.586902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.587048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:10.600473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:10.601777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:10.602763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 336/669] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:10.603516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.724532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299261b-51ba-454d-94c2-3c6968204dcd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.724976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f3bef-4780-4b86-b071-d7c618c5ce5b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.763718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.764537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.764921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.765267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.765854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.766478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.766823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.767166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.767874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:10.769238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.772437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.783532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.785429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.790132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 337/670] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:10.791162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:10.808606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:10.809833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:10.810907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:10.810907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.810907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:10.811731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 334/671] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:10.812741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.816754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.841754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:10.918062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156724ce-6dcb-4d5e-bd50-20e0e8bacf5c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.951160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a55c-ae89-4893-911d-fed3a86d1a17 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:10.958469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.959309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.959640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.960537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.972045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.973531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:10.991000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:10.991981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:10.992914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:10.992914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:10.992914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:10.993901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:10.994754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:10.995203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:10.995656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:10.996840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 338/672] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:10.996951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:10.997432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:10.997835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:10.999600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.015524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 335/673] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.016819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.089605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.123282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.136225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2f77b-f6fb-4827-b6ec-94afef3b1cb7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.162554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d3a64-0ded-4873-95ae-c243c2eef080 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.184187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.185044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.185334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.185614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.193803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.195940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:11.211481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:11.213572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:11.215736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:11.217494 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 339/674] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:11.218443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.228248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.229137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.229558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.229972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.230858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:11.231395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.234702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.249880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 336/675] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.255124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.340491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62367332-e91b-4a9a-ad0b-088b913fcaed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.368376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07103-1f99-4931-a6ca-806f0e1bea37 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.378393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.379125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.379409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.379691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.380964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:11.381279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.382642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.392779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.401114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 340/676] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.402085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.408149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.408789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.409067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.409336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.410067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=530609a984b24349a028bcf07ae290ca) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:11.410513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.412261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.413705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.424517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 337/677] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/role_assignments?user.id=530609a984b24349a028bcf07ae290ca&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.424517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.542353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951528e-ac9e-4e49-bbbb-8969da1e5294 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.562637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4a07e-bb97-40e2-9bff-f4f1f05980a2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.584513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.585247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.585539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.585809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.586513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:11.586822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.588473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.603089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 341/678] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.604266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.609007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.609653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.609977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.610248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.620256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.621827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-97d25895-2295-484e-bd8d-80506133de64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:11.636290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:11.637473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:11.638581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 338/679] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:11.639218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a796-f86e-43a5-a15b-417f78004f86 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.639218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a796-f86e-43a5-a15b-417f78004f86 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.639454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9a796-f86e-43a5-a15b-417f78004f86 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.640976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 339/680] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:11.641715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9a796-f86e-43a5-a15b-417f78004f86 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.700896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.701377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:11.748954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f7d84-3921-4aad-abc4-1036a317cbd5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.767036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9a796-f86e-43a5-a15b-417f78004f86 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.798730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.799301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.800024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.800024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.808023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.809503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.809875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:11.810492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.810775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.811049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.811802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fb66e8f0439d48fd9805921211801b65) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:11.812278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:11.813690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:11.821708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 340/681] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/role_assignments?user.id=fb66e8f0439d48fd9805921211801b65&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1b3cb5e7-dcfb-46ca-b2a7-f937173ba05f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:11.824041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:11.825519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:11.826622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:11.836673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.837022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 342/682] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:11.837022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:11.837022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:11.837022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:11.854730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:11.856278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:11.939426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 343/683] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:11.940337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:11.979329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802f7f-561d-4196-a4ee-1db8e2ba5181 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:11.995516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.033026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.033757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.034029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.034365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.035116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:12.035659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.038004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.056344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.066590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 341/684] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:12.067613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.105327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc8d2-8646-47ac-b7ef-fe7f41c62d72 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.156620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.157824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.158380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.158845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.159748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:12.160246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.162877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.176600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 344/685] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:12.179332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.205138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bfb6-2206-40d4-a037-b65d7e24d8c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.250922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.251811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.252093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.252365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.267144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:12.273547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:12.274520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 342/686] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:12.275791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.306935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72525-bc0f-4865-b73a-f7b6d9e73418 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.317735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.344904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.356039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.357362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.357916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.358624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.411864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2456a-872d-433e-a5ef-ad6cdc5b9b78 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.451981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.454408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.455235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.456120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.456511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.456954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.457790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=faba61a963e149c3a09e17bed3c2ce46) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:12.458217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.460897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.470112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 343/687] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/role_assignments?user.id=faba61a963e149c3a09e17bed3c2ce46&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:12.471292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.614412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.620109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 345/688] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:12.625613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.634234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b0d5-10c1-4d6b-92be-68ea03a7e8de None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.679552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.680590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.681694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:12.682904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.683444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.684356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:12.684883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.687912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.699477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 344/689] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:12.706499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.832362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5181-0fda-43f4-91b7-36f14041fc7f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.882871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.883465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.883745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.884284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.888580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea970978-59ce-4113-b2e5-e0b2e24b6ff1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:12.898551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.900604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:12.921363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:12.922397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:12.923312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:12.923312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:12.923312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:12.924658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 346/690] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:12.930367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:12.938828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:12.939966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:12.940597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:12.941102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:12.961214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:12.962838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:12.979560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:12.981836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:12.984049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:12.984049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:12.984049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:12.984049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 345/691] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:12.991325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.003845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:13.074432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:13.119053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751d491-728f-4c66-b708-8aba8fb48f3b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.159195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.159827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.160105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.160375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.161069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:13.161458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:13.163310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:13.176892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 346/692] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:13.186751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fcd80-de69-4466-b7ac-45379cc567ba None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.188745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.260435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.261250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.261548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.261844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.262531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:13.262835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:13.264251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:13.301315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 347/693] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:13.304109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.341669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:13.428803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb902c-bb18-42cd-a4cf-fb923b38fd5a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.488011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.488696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.488980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.489254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.498186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:13.499750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:13.514207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:13.516466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:13.518748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 347/694] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:50:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:13.524531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.633904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f50ff-f6a3-43bd-a3bf-9e6eab430fca None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.689563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0652f0-cb69-4ce0-978c-27e994a46fd8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.693981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:13.710158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.711127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.711127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.711414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.730687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:13.734085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:13.735633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:13.744308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.745202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.745747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.746187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.747285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:13.747740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:13.749348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:13.761055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:13.762179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:13.763262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:13.769738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 348/695] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:13.777062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 348/696] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:13.778206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.778622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:13.885458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cd64f-63be-463c-96fd-34e3ed04c491 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:13.923426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:13.924443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:13.924909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:13.925332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:13.996972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:14.019115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.022526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656256e2-2e69-4881-aa13-0901f977e7fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.053082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1676d4-c824-4e55-b165-0a8a4119fd5e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:14.125555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:14.126555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.127111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.127567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.128418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:14.129159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.131735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79425-fd4b-4770-bf3f-9fe09499b5be None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.146462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 349/697] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:14.148617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf693-e904-4ab3-a5dc-742602693687 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.149211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf693-e904-4ab3-a5dc-742602693687 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.149786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf693-e904-4ab3-a5dc-742602693687 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.152276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 350/698] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:14.153509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf693-e904-4ab3-a5dc-742602693687 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.224945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:14.294999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf693-e904-4ab3-a5dc-742602693687 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:14.357927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:14.357927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.357927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.357927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.358469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=11327e8df21f49039aab8222a571f1fa) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:14.358469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.358698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 349/699] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 16:50:14.358954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.360500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.361101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.361514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.367427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 351/700] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/role_assignments?user.id=11327e8df21f49039aab8222a571f1fa&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:14.368984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.386401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:14.388106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:14.474052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 350/701] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:14.502380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cb31f-1c59-41d5-b3db-806290d505f3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:14.514481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.528181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:14.539640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:14.566686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:14.567605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.568750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.569181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.584773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.586194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-94a1f561-99d7-4e36-bdfa-e8ab80ec80b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:14.604423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:14.605566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:14.606545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:14.606545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:14.606545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:14.606545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 352/702] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:14.612438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea0b8-3bec-4a75-bded-636080c238e8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.612758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea0b8-3bec-4a75-bded-636080c238e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.613064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ea0b8-3bec-4a75-bded-636080c238e8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.614575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 353/703] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:14.615164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ea0b8-3bec-4a75-bded-636080c238e8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.657610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808636d-4b9b-4235-9f2b-b6569cc05f48 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:14.713305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:14.714199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.714579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.714948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.729108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.731518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-48ca84a5-f064-4472-8e70-b30a6a812223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:14.748199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:14.749258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 351/704] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.755996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.765905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ea0b8-3bec-4a75-bded-636080c238e8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:14.774368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:14.775664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:14.819515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:14.820833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:14.821592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:14.822130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:14.823250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:14.823767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:14.826318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:14.848526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 354/705] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:14.848526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.865116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:14.874986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 352/706] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:14.876169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:14.894204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.002739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f2b3d-195f-4ffe-adec-445cd3c62c13 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.018136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df96c41-ac08-42b3-8e5b-91d4bf101bb6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.050977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.051985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.052965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.053742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.054706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:15.055362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.057850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.063701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.064593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.064995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.065443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.078127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 355/707] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:15.078127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.079623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.081612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:15.095657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:15.096702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:15.097635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:15.102753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 353/708] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:15.103619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.179234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.204669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.222134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd38b1-ab33-4982-b2c9-8d4123b194bf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.233914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce2163-b011-49d1-9cf1-4278cb475e2e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.262399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.263091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.263362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.263628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.264216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.265613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.277130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:15.277488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:15.278470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:15.279933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:15.280737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.280737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.280737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.280927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 356/709] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:15.280998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.281066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.281134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237812d-7af6-4fb4-8bf3-4e5307646612 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.316998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 354/710] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:50:15 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:15.319563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa68c68-25b4-46b3-bf96-a121ec542325 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.319859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa68c68-25b4-46b3-bf96-a121ec542325 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.320158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa68c68-25b4-46b3-bf96-a121ec542325 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.322257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 355/711] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:15.323008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa68c68-25b4-46b3-bf96-a121ec542325 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.414496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d2eed-beb3-4837-bcec-e1ab67a14603 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.455100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa68c68-25b4-46b3-bf96-a121ec542325 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.458279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.459242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.459787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.460261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.461360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:15.461898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.463623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9629744-9fcb-4d9a-a74f-644f68e60603 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.471386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.478857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 357/712] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:15.480635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.481134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.481611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.502318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:15.503910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:15.507395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.508025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.508308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.508639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.508893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.510429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:15.510840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.512350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.518614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 356/713] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:15.519392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.592466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 358/714] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:15.593951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.641580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd13ef4-be76-489f-9da4-4408f8e41e52 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.688217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.689484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.690031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.690503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.691566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:15.692096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.694424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.701719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 357/715] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:15.703058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.717133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d3e8-4ff6-4488-b0b6-1415c467d3c4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.757091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:15.763623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.764185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.764527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.764812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.765407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:15.765704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.767475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.782286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 359/716] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:15.861310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c960a-1ac9-44cc-b384-b922f738d5d0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:15.910215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:15.912352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:15.912848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:15.913330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:15.914132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:15.915994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:15.936118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:15.938458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:15.940587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:15.945486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 358/717] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:15.952605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:15.960271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:16.097924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c508d76-0411-4ba0-b71e-89e34109ef46 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:16.139975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:16.140621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:16.140896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:16.141202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:16.142020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:16.142321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:16.143692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b5d-91fd-4f3a-8644-2c8c32bff4ac None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:16.154940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 360/718] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:16.157140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:16.305465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cae656-544f-42e9-ad5e-573cade24e7a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:16.313722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:16.366087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:16.366907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:16.367206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:16.367613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:16.368796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:16.369226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:16.370645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501fce3-a70f-43fe-af97-88d38339cca7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:16.383481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 359/719] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:17.023601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea929b-d000-48c8-9862-da6ac8c4939e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:17.024097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea929b-d000-48c8-9862-da6ac8c4939e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:17.024097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea929b-d000-48c8-9862-da6ac8c4939e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:17.025751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 361/720] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:17.032411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:17.033031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:17.033161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:17.061511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:17.062724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:17.159101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 360/721] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:17.200330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea929b-d000-48c8-9862-da6ac8c4939e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:17.304944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:17.361914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea929b-d000-48c8-9862-da6ac8c4939e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:17.414668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:17.415584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:17.416066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:17.416568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:17.441893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:17.449799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:17.451197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:17.452123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 362/722] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:17.461774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:17.610663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:17.617055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626e41-74d3-4dbc-8a93-9f5915f9eb2b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:17.661718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:17.662371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:17.662656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:17.662994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:17.663672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:17.663977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:17.665548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:17.681431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 361/723] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:17.686668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:17.868305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3a4be-5e83-468c-b9b0-377aff89c2fd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:17.911565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:17.926319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:17.926985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:17.927264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:17.927594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:17.949643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:17.951461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fec604a6-a70c-4a07-a6e6-b5b142dd6d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:17.972953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:17.974445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:17.975620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:17.975620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:17.975620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:17.975620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 363/724] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:17.980613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.154487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b13c41-55ea-4023-8aba-acebe163d441 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.155367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b13c41-55ea-4023-8aba-acebe163d441 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.155367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b13c41-55ea-4023-8aba-acebe163d441 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.156703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 364/725] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:18.160013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93707e-930b-494d-bd1a-427b80479a37 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:18.163063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.163457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.164243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.189032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:18.190996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:18.235173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:18.235827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.236133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.236411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.237103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:18.237470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:18.238902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:18.268609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 362/726] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:18.274761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.320237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 365/727] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 16:50:18.329321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:18.370887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.475032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ac6e-eb5f-4345-adb1-e372d7f86082 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:18.519538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6b4be-26c5-456b-8528-449dcc352598 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:18.524471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:18.525418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.525873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.526387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.531477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:18.537104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:18.539569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6f0d2673-2e30-457b-8843-4b43cbd0ce76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:18.555844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:18.557117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:18.558128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:18.560306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 363/728] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:18.561838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b039a-3cd8-4295-8b52-7708945e0f61 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.562401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b039a-3cd8-4295-8b52-7708945e0f61 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.562852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b039a-3cd8-4295-8b52-7708945e0f61 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.564135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:18.568569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.568569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.568569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.569254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 364/729] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:18.570557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b039a-3cd8-4295-8b52-7708945e0f61 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.579717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-347a11d5-7aad-4095-bc32-912b9e23a2db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:18.586006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:18.587044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 366/730] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:18.589358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545b7a-e515-4c49-8546-e79e8aca2b11 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.590797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545b7a-e515-4c49-8546-e79e8aca2b11 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.590797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12545b7a-e515-4c49-8546-e79e8aca2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.609516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-12545b7a-e515-4c49-8546-e79e8aca2b11 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:18.610935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-12545b7a-e515-4c49-8546-e79e8aca2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:18.695623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 367/731] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:18.696841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79acd0-bab8-432a-aef5-fe95ee55bd1e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.697315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79acd0-bab8-432a-aef5-fe95ee55bd1e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.697436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79acd0-bab8-432a-aef5-fe95ee55bd1e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.703385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 368/732] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:18.704097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79acd0-bab8-432a-aef5-fe95ee55bd1e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.726469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:18.749074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b039a-3cd8-4295-8b52-7708945e0f61 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:18.792028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:18.792586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.792862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.793173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.793978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:18.794239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:18.795671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a0f59-f99b-4630-846b-90100e17c2e0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:18.814521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 365/733] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:18.815838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.816103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.816380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.835833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:18.837029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:18.849851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:18.857080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79acd0-bab8-432a-aef5-fe95ee55bd1e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:18.900980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:18.901843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:18.902172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:18.902473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:18.903230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:18.903527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:18.905452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:18.924509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 366/734] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:18.924509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:18.924780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 369/735] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:18.924780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.003682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.043969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc8239-7709-4bab-98c7-3ae42ae87a4c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.044192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342f799-ef23-4178-879c-aa9e8fc6a57d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.083884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.084530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.084846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.085107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.087841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.088598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.088891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.089162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.095212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:19.100020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:19.101026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 367/736] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:19.107431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.135057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.186213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.187647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.216733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d4b37-026a-4617-be9f-5ab6fe8146a9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.248114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.257296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.257854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.258173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.258867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.268866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.270367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:19.291299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:19.292348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:19.293272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:19.293272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.293272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:19.293272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 368/737] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:19.293597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.302371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 370/738] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 16:50:19.303608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.370108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.403227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1e82c-6dbb-4583-b3d9-b1cea4e2de39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.413770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bf4c0-5942-4938-838a-9f9b73078c83 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.440809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.441415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.441691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.441968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.443348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.444597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f29277-7606-4f19-a23a-f67a361da758 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.449890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.450756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.451221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.451589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.452239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:19.452580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.454101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.460841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 369/739] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:19 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:19.462077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496005-a7c6-40c6-85f8-dc8595139338 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.462364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496005-a7c6-40c6-85f8-dc8595139338 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.462634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed496005-a7c6-40c6-85f8-dc8595139338 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.471448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 371/740] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:19.471748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 370/741] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:19.471748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed496005-a7c6-40c6-85f8-dc8595139338 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.471928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.524755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.604985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dad303-512f-4b47-afbd-9c86aa475756 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.611310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed496005-a7c6-40c6-85f8-dc8595139338 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.633361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.651517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.652375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.652842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.653252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.654139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:19.654614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.656123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23e22-951b-4ca2-8b13-c0bd6f2f292e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.665804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.666455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.666738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.667013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.671139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 372/742] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:19.672154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.672273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.672589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.679690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.681222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.691425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:19.693823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:19.697660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:19.698652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:19.699567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:19.699567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.699567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:19.699567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 371/743] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:19.700630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.785966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 373/744] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 16:50:19.787004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.821611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.838760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da4395-6bcc-4fe1-8d66-07f70c1858c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.881499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.882140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.882482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.882761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.896509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.898171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.915183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761235b-1bfe-45d6-9ca8-88114955b683 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:19.915868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:19.917006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:19.917914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:19.917914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:19.917914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:19.917914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 372/745] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:19.917914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:19.939210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:19.963662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:19.964466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:19.964831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:19.965100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:19.977526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:19.978796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:19.999781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:20.000866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:20.001861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 374/746] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:20.002453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.051820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e9de3-90b0-4a0e-967f-98c02581be20 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.094415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.095032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.095362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.095795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.096234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:20.096556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.097965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.112026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:20.117152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 373/747] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:20.117980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.149478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c04012-1e38-423e-89b4-a639b6187eb1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.208329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.209383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.209859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.210322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.211407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.214196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.252520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 375/748] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:20 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:20.252520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.270820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de6875-dedb-41dc-a1cb-d5ceeaf5242c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.301653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:20.348064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.349552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.350146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.350523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.351793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:20.352354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.354431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.374014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 374/749] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:20.375145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.419103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbc7-05b9-4785-a23c-4e6246b56f88 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.463630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:20.482941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.483681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.484219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.488520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.488520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:20.488520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.488520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.517678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 376/750] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:20.518914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.544557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1d072-cc0d-4789-8912-73ef25ab4e0e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.609743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.610936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.611419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.611857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.624255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.625835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:20.642983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:20.645383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:20.648169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 375/751] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:20.652274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.674881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:20.694977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed2e5-7cba-491a-9e05-4a9f5487c64f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.751729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.752712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.753351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.753803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.763127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.765299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:20.778593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:20.779597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:20.780552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:20.783181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 377/752] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:20.784171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:20.811722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c8c13-7cc3-4aa4-8255-c64a8d449f1c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.834386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:20.857990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.859040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.859522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.860043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.925337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b49160-8ee7-4ec8-b9c1-2edc5068dcad None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:20.942076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.944190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:20.971653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:20.973011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:20.973495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:20.974555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:20.976833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:20.977720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:20.980177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.000566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 378/753] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:21.001781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.027688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.063985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 376/754] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:21.065217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.091924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.140144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb3a57-30ec-45cf-88db-ab0501052db7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.186438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.187517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.187999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.188469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.189441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:21.189966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.191655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.201656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4641f5-515e-421e-860b-e649aad2591a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.215623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 379/755] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:21.217251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.245400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.246029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.246582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.246898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.247749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=11327e8df21f49039aab8222a571f1fa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:21.248105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.249894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.260587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 377/756] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/role_assignments?user.id=11327e8df21f49039aab8222a571f1fa&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:21.261843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.353150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.420558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe741-0868-49ad-a653-d409bb995905 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.463069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.510532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.511808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.512539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.513417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.516039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1826e5d-ade1-4239-a8f6-053934d74542 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.538168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.539844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.570582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.571614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.572098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.572727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:21.575313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:21.576258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:21.577163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:21.577163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:21.577163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:21.580379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 380/757] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:21.588128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.600596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.602385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:21.627795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:21.628861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:21.629760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:21.629760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:21.629760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:21.637629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 378/758] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:21.644795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.802711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754bf9-32f8-49aa-bc22-3641ad1feae9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.838392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.854673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbf3d-6a2a-451e-a9f7-528802d7bd8f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:21.856806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.858055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.858679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.859191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.860273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:21.860860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.862946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6898e-00d8-44a1-93e5-f9e6e7e05c23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.880985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 381/759] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:21.882630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe3f-7501-43ff-b0f4-d1916f00f996 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.887977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe3f-7501-43ff-b0f4-d1916f00f996 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.889503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dbe3f-7501-43ff-b0f4-d1916f00f996 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.891280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:21.891654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 382/760] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:21.892703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbe3f-7501-43ff-b0f4-d1916f00f996 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:21.900385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:21.901253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.901675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.902086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.902882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:21.903328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:21.904993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceba2f0-146f-4551-a662-21d7e3662f3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:21.923561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 379/761] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:21.925248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:21.925690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:21.926103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:21.949205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:21.950856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:22.019243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dbe3f-7501-43ff-b0f4-d1916f00f996 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.038035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 380/762] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:22.039312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.079550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.080471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.080782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.081057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.089068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.090739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:22.103414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:22.104534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:22.105574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 383/763] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:22.106080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.157876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.224229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329a754-b695-43c4-86c2-307a83fd6977 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.231691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca423-20b7-4f78-95a3-780cbf728075 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.251250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.266602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108335-98ea-4c51-8819-59046a922bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.267923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108335-98ea-4c51-8819-59046a922bce None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.268591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108335-98ea-4c51-8819-59046a922bce None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.269194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108335-98ea-4c51-8819-59046a922bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.271706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.272457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.272843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.273167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.273816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.275244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.280736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108335-98ea-4c51-8819-59046a922bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.282704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108335-98ea-4c51-8819-59046a922bce None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:22.284821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:22.286279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:22.287670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 384/764] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:22.294642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-28108335-98ea-4c51-8819-59046a922bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:22.308907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:22.309985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:22.311079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:22.318792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 381/765] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:22.318792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108335-98ea-4c51-8819-59046a922bce None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.417573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da0576-1a38-47ad-99a5-3b3b7a98d575 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.426319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.459920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.461097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.461621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.462128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.463162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:22.463663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.465632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.480520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 385/766] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:22.481954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.482065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108335-98ea-4c51-8819-59046a922bce None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.529750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.530497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.530820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.531158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.531961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:22.532322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.533967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.544222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 382/767] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:22.545321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.605087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650caa33-521f-4cda-bb81-5e87f30e1d9e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.615042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.649825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.650838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.651351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.651801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.652846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:22.653249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.654783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.674642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 386/768] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:22.675733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.701054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba55d-93c6-4c1a-a9e5-b8b9bb4040f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.711781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.755603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.756044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.756509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.756863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.757682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=1e26dcedde9c427c86879a5d1516305c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:22.758149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.760285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.767455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 383/769] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/role_assignments?user.id=1e26dcedde9c427c86879a5d1516305c&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:22.768258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.831797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716106-277b-47a3-a0cd-a6472ecf6fbc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.890801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.892045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.892528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.893554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.894972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:22.895686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.898389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dc3ae-1d75-434c-8665-9b5baa5ce0d2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:22.910761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 387/770] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:22.910761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af3bb-9446-486d-af63-a8af51266a0a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.910761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af3bb-9446-486d-af63-a8af51266a0a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.910761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af3bb-9446-486d-af63-a8af51266a0a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.915440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 388/771] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:22.917017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af3bb-9446-486d-af63-a8af51266a0a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:22.924972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681ca2d-71ce-4616-be04-79222d0c5910 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:22.938231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:22.970624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:22.971406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:22.971686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:22.971958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:22.974665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=ca316ae3b4d84309af586fbb5aa61dd7, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:22.976090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a317533-c53e-41fd-9a72-90605b2257ab None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.000700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 384/772] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:22 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:23.002495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.002802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.003134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.034174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:23.035613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:23.086593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:23.101683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af3bb-9446-486d-af63-a8af51266a0a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:23.145333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:23.146439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.146723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.147003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.147786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] RBAC: Adding query filter params (interface=public, service_id=068e179c80b14abbb7ffd811ac2ad740, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:23.148101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:23.150148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.163671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 389/773] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:22 2022] GET /identity/v3/endpoints?service_id=068e179c80b14abbb7ffd811ac2ad740&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:23.165811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:23.172326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 385/774] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:23.217534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:23.338483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedd215-3c6e-4b7e-9f03-418e58be5799 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:23.376214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:23.380927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7b277-ffa2-4147-9da5-0ed6cb9ef956 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:23.406630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:23.407248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.407528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.407798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.408411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:23.409810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.423749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:23.424779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.424963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 390/775] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:23 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:23.425434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.425975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.427322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:23.429429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:23.441617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:23.443531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:23.445095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:23.448037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 386/776] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:23 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:23.454797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:23.487083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:23.601836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f150f-8161-4e48-bc8a-1bf177366ca9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:23.641724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:23.642341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.642622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.642896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.643541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:23.643843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:23.645274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.652526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 391/777] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:23.657318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:23.787105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddf27d-1af5-4967-a373-bf857c79848c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:23.828837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:23.829447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.829734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.829993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.830680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:23.830982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:23.832394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c46066-0bae-41d2-8891-1d7650e01fa5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:23.837960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 387/778] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:23.843638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:23.857770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa34ca-8492-4879-8e90-2de562ad7946 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.858469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa34ca-8492-4879-8e90-2de562ad7946 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.859025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa34ca-8492-4879-8e90-2de562ad7946 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.860611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 388/779] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:23.866176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:23.866746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:23.867242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:23.888027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:23.889580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:23.920796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:23.974515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 389/780] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:23.992870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:24.001427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:24.022086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbb982-c12d-4f21-990d-bec2566a146f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.089941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.090841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.090841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.091148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.091865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] RBAC: Adding query filter params (interface=public, service_id=8a2128b9bca441828eafc810b08a1ae1, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:24.092173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:24.093558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:24.107730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 392/781] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:23 2022] GET /identity/v3/endpoints?service_id=8a2128b9bca441828eafc810b08a1ae1&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:24.113221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:24.122025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f773c6-eb22-4e1a-b85b-151223c6f8a2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.166096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.167288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.167843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.168421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.184027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:24.190428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:24.191965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:24.193712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:24.197146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 390/782] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:24.204514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:24.262609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:24.269780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c3806-c33a-4546-93f3-f6bde4655d69 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.316792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.317439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.317782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.318515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.319464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:24.321045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:24.333903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 393/783] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:24.407107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aaeb-86fe-4887-9290-ca994639712c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.460834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.461458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.461742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.462015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.462689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:24.463174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:24.465285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:24.482130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 391/784] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:24.491980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:24.508448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:24.671642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98caf6-6b6c-4a9f-8b68-1f03e7100662 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.718453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.719180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.719509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.719827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.733904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:24.736183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:24.754370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:24.755496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:24.756371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:24.756371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:24.756371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:24.756579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 394/785] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:24.763318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:24.874459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:24.901110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63bbbf-8508-4143-8aee-3c4883512dba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:24.956221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:24.957398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:24.957944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:24.958605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:24.959569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:24.960088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:24.961756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:24.982817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 392/786] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:24.988866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:25.078829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:25.140416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1dd7-064d-4a45-8457-3218bf16e6d8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:25.194048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:25.195746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.196619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.197330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.217490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:25.219620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:25.233491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:25.234454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:25.235378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:25.237599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 395/787] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:25.244020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:25.385684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ce2e7-2932-4cea-8112-5d008fee00e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:25.437534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:25.438537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.439011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.439489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.440423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:25.441079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:25.443149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0ce25-adc0-4797-a2d2-bebc30a07860 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:25.465809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:25.479175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 393/788] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:25.485443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:25.514717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b105e-7c9a-487d-aeb9-778ecd312034 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.515081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b105e-7c9a-487d-aeb9-778ecd312034 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.515447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b105e-7c9a-487d-aeb9-778ecd312034 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.517033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 394/789] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:25.522501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d145-2202-4f7a-aa90-08b0eace95c1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.522782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d145-2202-4f7a-aa90-08b0eace95c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.523050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d145-2202-4f7a-aa90-08b0eace95c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.549235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cdd3d145-2202-4f7a-aa90-08b0eace95c1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:25.550662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdd3d145-2202-4f7a-aa90-08b0eace95c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:25.707363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 395/790] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:25.716304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281c4f8-0c8b-4233-8925-2229032d5ee4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:25.729082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116629d-1d4a-44ea-a349-a932012e7e02 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.729513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116629d-1d4a-44ea-a349-a932012e7e02 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.729775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116629d-1d4a-44ea-a349-a932012e7e02 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.731662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 396/791] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:25.738296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.738683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.738974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.760344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:25.764761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:25.766849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:25.774057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:25.774806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.775182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.775550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.786930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:25.788687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:25.803973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:25.805441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:25.806792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:25.806792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:25.806792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:25.807825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 396/792] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:25.808804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:25.861012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 397/793] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:25.862307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:25.938992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:25.942316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1b2c8-eefe-4a4b-a3f3-923ccdf52175 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:25.988091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:25.989773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:25.990067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:25.990465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:25.993142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9387a5-c381-4642-b73a-5cf5983766c3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.002799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:26.009662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:26.010755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:26.011585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:26.016508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 397/794] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:26.017648 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.036681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.037664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.038184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.038464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.039113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:26.039415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.040832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.057560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 398/795] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:26.058784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.065208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.174693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e6ab4-669a-4464-b0bd-2b9a0d62bf23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.176737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde255-e60b-4cbb-a7dd-f3c3737f5873 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.199526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.223990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.224493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.225151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.225428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.225698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.225966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.226649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.227129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.228118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:26.228660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.230340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.241062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:26.248213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:26.250960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 398/797] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:26.254955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.260400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 399/797] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:26.260400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.399558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.402917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56fe28-8740-4cb2-9dea-3870f848974a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.408887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc7f50-a717-4d97-9691-df46a41ae3d0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.452360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.453020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.453340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.453567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.455352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.456016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.456378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.456798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.457534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:26.457949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.459387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.461854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.463529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.469159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 400/798] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:26.470005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:26.484656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:26.485622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:26.486508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:26.492837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 399/799] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:26.493883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.520883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.584330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ad840-1f19-47eb-b579-0ed6550ce087 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.619113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.619747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.620025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.620294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.622625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8824d-e181-4e80-8200-d88d6b071306 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.632611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.634070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:26.652806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:26.653968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:26.655452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:26.655452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:26.655452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:26.655452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 401/800] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:26.655452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.679220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.679992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.680312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.680688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.697817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.701367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4b1b50e3-5836-4ba8-a994-2312884b1aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:26.723393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:26.727912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 400/801] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642889d8-01ad-4b88-ab13-e5383ef8fae3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642889d8-01ad-4b88-ab13-e5383ef8fae3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642889d8-01ad-4b88-ab13-e5383ef8fae3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.731007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 401/802] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:26.733342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642889d8-01ad-4b88-ab13-e5383ef8fae3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.746274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.802529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:26.812439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba899d78-6204-4358-9f1f-4b46d2b27ecc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.860176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.861065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.861467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.861858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.862889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:26.863337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.866131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.884830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 402/803] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:26.886022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:26.896981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642889d8-01ad-4b88-ab13-e5383ef8fae3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:26.943115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:26.943890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.944229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.945108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.945895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:26.946270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:26.948033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66481-4dcb-4561-891d-f67adfe80d88 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:26.969248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 402/804] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:26.969248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:26.969248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:26.969248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:26.988260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:26.990674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:27.006830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424f79-19d8-4344-953f-eddead1f3180 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.051064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.051808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.052205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.052552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.053156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:27.053463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.054843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.067300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 403/805] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:27.069865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.072581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.090496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 403/806] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:27.090496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.091131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.231769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539e95a-9e09-4038-bf5d-419ee99b9da1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.231974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632590e-301e-44a2-8416-e13c0747c76c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.271191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.271737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.272015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.272316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.273474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.274138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.274420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.274694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/11327e8df21f49039aab8222a571f1fa/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.276620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=11327e8df21f49039aab8222a571f1fa, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.278051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.279937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.281439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.293373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 404/807] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:27 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/11327e8df21f49039aab8222a571f1fa/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:27.294304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:27.296528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:27.297490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:27.298429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 404/808] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:27.299018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.380055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.402054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.435849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79580-a407-4700-8553-a81c50afa1bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.447810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522678f8-7a6d-4bc9-afea-0066acfcb657 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.483116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.483762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.484064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.484339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.495210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.496886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.497673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.498565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.499032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.499438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.500417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.502293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79f8e104-a212-40f1-b106-4c4e0e06ce57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:27.510947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:27.512201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:27.513535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 405/809] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:27.514614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:27.516903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 16:50:27.518841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:27.519673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972287-b9b4-444a-9b98-9faa6c0d3226 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.519673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972287-b9b4-444a-9b98-9faa6c0d3226 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.519673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e972287-b9b4-444a-9b98-9faa6c0d3226 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.519862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 405/810] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:27.519862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.528873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 406/811] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:27 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:27.529797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e972287-b9b4-444a-9b98-9faa6c0d3226 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.640941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3561a4f-2254-4188-aafe-d8b87c6dcc47 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.668598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.672200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e972287-b9b4-444a-9b98-9faa6c0d3226 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.690936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.691681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.692036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.693114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.693954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:27.694399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.696113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.718159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 406/812] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:27.718935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.723670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.724463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.724812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.725094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.725796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:27.726102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.727551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5b3e1-6940-4ab1-8c05-db1c6ef2d6b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.729870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.754207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 407/813] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:27.754207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.754207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.754207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.771756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:27.773080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:27.851444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 408/814] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:27.852314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.864781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e872a-8fa3-464d-8d84-37d45c4395e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:27.903556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:27.904270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:27.904646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:27.904985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:27.905647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:27.905952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:27.907418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:27.912605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 407/815] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:27.913405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:27.965430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:27.980751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a46efa-c73e-4307-9b25-7d9bc42960c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.012365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.027272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.028095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.028380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.028683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.039605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.041094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.050540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9c0e9-7381-4a59-945e-c8378caf95a0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:28.058201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:28.059345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:28.060466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:28.060466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:28.060466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:28.066027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 409/816] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:28.066027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.100102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.101420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.102092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.102419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.176360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c955-b833-4b20-9394-e5a1c07dd6c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.192441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.194470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.217142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.218042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.218457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.218905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.219690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.221488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:28.231933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:28.233355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:28.234309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 410/817] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:28.235820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.247237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.290497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.322159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 408/818] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:28.323369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.368005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecefde-beee-4de2-9d7c-445156f63b00 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.416972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.417580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.417859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.418127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.418761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:28.419060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.420459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.432524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 411/819] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:28.432524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.451181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35d198-39f3-4dec-88c9-1a619025335c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.501227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.501916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.502211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.502519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.503245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:28.503564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.505983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.524004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 409/820] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:28.530727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.535308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.572970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516d4d8-6f43-4d8d-a3d0-b1a6e11dde3e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.575726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.622156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.622682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.622958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.623235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.624616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] RBAC: Adding query filter params (name=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:28.624616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.625555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.632259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 412/821] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:28.632259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.665287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d779838-31fd-4d69-b9aa-a0835113a004 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.716000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.716653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.716979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.717201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.733888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.735349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:28.754186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:28.756612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:28.758013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:28.758013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:28.758013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:28.761436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 410/822] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:28.761975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.765304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d12be-ea88-4d80-876b-b3e353b4cc44 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.813227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:28.813984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:28.814342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:28.814634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:28.815392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:28.816913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:28.842178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:28.857057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 413/823] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:28.860020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:28.910131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce292-02b0-4367-98b4-c0555a61a555 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:28.912502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.007107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.008026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.008411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.008843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.018913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.021677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:29.035639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:29.037301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:29.038968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:29.041111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 411/824] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:29.042453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.058889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffc88b-cfa7-47ed-a356-dd833f17da3f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.108435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.109087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.111307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.111307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.111307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:29.111307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.111927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.118346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 414/825] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:29.119569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.183205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24939e-add1-4ada-affa-b97162b4beb3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.197383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.227085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.228111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.228728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.229206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.230070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:29.230577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.232165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.234142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.247160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 412/826] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:29.253191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13fde5-a04d-412d-8598-b625b1222fcd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.253715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.298288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.298909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.299189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.299464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.300171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:29.300475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.302803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.322956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 415/827] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:29.322956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.383180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c696d3-921f-49bf-bffa-73b37232cd07 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.428963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.429980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.430503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.430995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.431912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.433687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.447792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee363763-c879-403b-85f5-80641fab2b04 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.467829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 413/828] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:29.469284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.493559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.494224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.494489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.494770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.504511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.504511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:29.520825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:29.521945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:29.522823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:29.523807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 416/829] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:29.525062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.527964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.532562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.628784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc74736-b0ce-44be-93a3-db85ebca5fe5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.692548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.692548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.692548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.692548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/1e26dcedde9c427c86879a5d1516305c/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.712912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=1e26dcedde9c427c86879a5d1516305c, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.714417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841caa0-453e-42b5-bcd9-2fedf80a9d8c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.740790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 414/830] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:29 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/1e26dcedde9c427c86879a5d1516305c/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:29.741016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a52a83-5882-4a40-b4fc-05aeccce03db None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:29.742346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7356-a430-49ba-8831-e3d2bbe7569a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.742804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7356-a430-49ba-8831-e3d2bbe7569a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.742941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f7356-a430-49ba-8831-e3d2bbe7569a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.744722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 415/831] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:29.754569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.755226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.755657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.791879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:29.793501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:29.803550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:29.805325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:29.805887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:29.806617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:29.808619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:29.809217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:29.811623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:29.829225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 417/832] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:29.835906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.900096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 416/833] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:29.934466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.942574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:29.953894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:29.996588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b15ae-749d-4852-86b3-7016feae3e09 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:30.056325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:30.057262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:30.057541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:30.057818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:30.058558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:30.058866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:30.061473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:30.076533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 418/834] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:30.109073 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cbff8-8ff0-467b-9429-3c54aae0fc62 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:30.155867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:30.156552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:30.156837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:30.157107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:30.172306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:30.177956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:30.179333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:30.180843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 417/835] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:30.188935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:30.318906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd1d23-5430-464a-b48f-95eb26f0b6af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:30.350169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:30.367619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:30.368853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:30.369490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:30.370097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:30.371410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:30.372073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:30.375056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:30.400631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 419/836] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:30.403540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:30.529804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:30.593779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3d79a-f5d8-48ba-a202-830ae153f279 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:30.656331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:30.657377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:30.657834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:30.658277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:30.676642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:30.679257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:30.699938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:30.701586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:30.702732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:30.702732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:30.702732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:30.709157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 418/837] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:30.713307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:30.845078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e917-22de-4d8d-a860-a920d498d364 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:30.887540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:30.888640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:30.889109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:30.889679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:30.890618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:30.891128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:30.892931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:30.907259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 420/838] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:30.917036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.042818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c38e9-a8c3-4a31-8041-926c91b1bf80 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.064324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.085445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.086190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.086555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.086880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.096617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.098246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:31.113001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:31.114935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 16:50:31.116224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:31.120611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 419/839] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:50:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:31.123070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.186803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.251437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266a878-c841-43b7-8306-9ee3f585dbdd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.292128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.292769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.293049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.293325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.294063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:31.294364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.295788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71689c2-843d-4f15-aa37-6a27b5d1dbe0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:31.316576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 421/840] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:31.323148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.422048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824534f1-cf6e-4af7-b24c-f37580364fd4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.422462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824534f1-cf6e-4af7-b24c-f37580364fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.422658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824534f1-cf6e-4af7-b24c-f37580364fd4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.424668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 422/841] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:31.432285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.432768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.433204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.435701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018d93a-6381-4a41-8363-6d08c958b0e8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.459269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:31.460911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:31.473635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.473965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.474143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.474409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.541007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.558631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 423/842] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:31.567898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.570126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:31.590523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.638970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.728658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 420/843] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:31.729382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9a28-e3a6-45cc-95a4-c72094aa47f7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.731268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.774494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.775612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.776092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.776616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.777429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.779494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:31.792317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:31.793396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:31.794647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:31.804825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 424/844] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:31.805478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.835932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.866426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c4d5-ac2a-4daf-ab38-5b64ac7cc14e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.915962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.916853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.917453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.917819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.931166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:31.933540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.935127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:31.935240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed68cb6-e5fa-4245-96a7-de42490c62ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:31.956031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:31.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:31.963827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:31.963827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:31.963827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:31.963827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 421/845] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:31.965719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:31.985757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:31.986638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:31.986940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:31.987208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:31.987908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:31.988215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:31.990521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.001870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 425/846] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:32.002814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.111257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdaeb5-5ce7-4cbd-96e9-81c7601684d6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.127180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026956d-78f0-4886-a704-25dedcd0fda1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.148654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.149322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.149677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.149921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.150547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:32.150847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.152218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.164950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 426/847] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:32.183812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.195794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.196830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.197316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.197812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.198926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:32.199431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.201488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b30b1-9a14-4163-a3e7-d5fc90075e90 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.216919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 422/848] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:32.224913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.238545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe1-d3a1-4b0e-9eb4-6fb2d27bc31c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.238989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe1-d3a1-4b0e-9eb4-6fb2d27bc31c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.240188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945fe1-d3a1-4b0e-9eb4-6fb2d27bc31c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.241977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 423/849] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:32.248252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.248591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.248932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.258570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.273635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:32.274959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:32.342211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840483db-b040-4983-97e0-17d0a508ed14 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.363039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 424/850] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:32.386530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.387666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.387666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.388520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.390974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.398855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.400456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:32.417202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:32.418574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:32.419817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:32.421334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 427/851] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:32.427658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.536984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.541951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396ef44-9a9c-4dd7-b938-b1505aba3693 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.550807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6b41a-69ad-4636-a849-fec46f634781 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.570061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.591363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.592113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.592444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.592777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.594635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.595292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.595551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.595825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.596561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:32.596872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.598931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2931a7-ddcd-4f54-9457-80be34c33352 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.607344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:32.619325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 428/852] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:32.619325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5146ac-8bd5-4dbf-9c3f-11fdb3e41e60 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:32.619662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:32.620941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:50:32.621963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:32.622771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5146ac-8bd5-4dbf-9c3f-11fdb3e41e60 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.622771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5146ac-8bd5-4dbf-9c3f-11fdb3e41e60 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.622771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 429/854] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:32.622993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 425/854] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:32.622993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.623119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.623119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.623119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.641211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:32.642455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:32.730155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 430/855] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:32.731307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.762346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c150a8-b8f7-489c-818e-7168f0ddb926 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.805448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.806439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.806984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.807408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.808302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=11327e8df21f49039aab8222a571f1fa) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:32.808790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.810419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.817705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 426/856] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/role_assignments?user.id=11327e8df21f49039aab8222a571f1fa&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:32.818818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:32.871607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.884896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:32.909439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6910ae7-5cd4-4287-ac15-95853d0e8776 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.970708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947a54-5b06-4bc0-8fa7-68a447899970 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:32.972694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:32.974208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:32.974529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:32.974802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:32.975494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:32.976672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:32.977446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:32.992771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 431/857] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:32.994117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.019681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.020641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.021069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.021510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.022108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.023510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:33.039281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:33.040389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:33.041497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 427/858] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:33.051250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.161649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199380f-763a-4277-9672-e39aca0d7322 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.205069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.205932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.206277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.206587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.209388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439b7e-eac9-4fa5-be5e-6e3887772704 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.218588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:33.220801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:33.221511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.224104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:33.243291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:33.244318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:33.245278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:33.245278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:33.245278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:33.245278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 432/859] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:33.252727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.256855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.257878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.258244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.258671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.259589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:33.259903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.261895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.272592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 428/860] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:33.273913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.391890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e302b2-6a59-496f-b424-a11c2c32cb36 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.414393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53671af-49be-4132-bc26-9a0366fb7fc1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.435916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.436717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.437130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.437461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.438211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:33.438563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.440106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.452684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 429/861] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:33.467063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.467807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.468163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.468453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.469345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:33.469709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.471378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.488417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 433/862] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:33.494720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.543212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:33.636692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25879c-35f3-4c1d-9966-52dcef699d2f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.681442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.682007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.682283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.682556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.691375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.696675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:33.710352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:33.711509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:33.712607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:33.716302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 430/863] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:33.718146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:33.789980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:33.849198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30b200-6b82-447d-94dd-a1fb10d29779 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:33.889621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:33.890338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:33.890666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:33.890985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:33.891873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:33.892208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:33.893918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:33.916165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 434/864] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:33.922875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.050360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:34.060033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35c60-fb1d-49ce-b4a8-057f85aa5f57 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:34.103238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:34.104206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.104744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.105215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.182214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:34.184087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:34.298576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:34.308103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 431/865] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:34.315687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.446049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77314d-3f2d-4dd8-b331-04ba26f7bee1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:34.460090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:34.489428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:34.490424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.490990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.491462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.503048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:34.504869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b22ec289-d7fe-4a57-b077-8228ef7b4223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:34.521573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:34.522659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:34.523664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:34.523664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:34.523664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:34.526037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 435/866] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:34.533630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.629500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76653d-b4fb-47a3-9d25-5cccabd03aad None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.630261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76653d-b4fb-47a3-9d25-5cccabd03aad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.630531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76653d-b4fb-47a3-9d25-5cccabd03aad None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.632096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 436/867] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:34.638134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.638776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.639269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.658281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68edec1-0a15-4e18-b417-62c74f3fe7c3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:34.669095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:34.670616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:34.709846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:34.710807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.711132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.711434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.712651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:34.712995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:34.715050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:34.732895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 432/868] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:34.741967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.768525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 437/869] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:34.802347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.829667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:34.897340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46160-0f70-498a-bfaf-1eb41140cf58 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:34.922762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:34.934566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:34.935200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.935481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.935595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a8f3-b29c-4f9e-8db7-335a304436e8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:34.935777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.944203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:34.945677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:34.961539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:34.962480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:34.963500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 433/870] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:34.970831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:34.983876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:34.984654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:34.984991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:34.985378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:34.986040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:34.987534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:35.008347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 438/871] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:34 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:50:35.109661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e554ab6-c61c-4894-a335-7ab1e9a2f187 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:35.130613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:35.160592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:35.161843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.162169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.162445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.163167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:35.163475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:35.165056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fce361-fb00-437b-90c1-fdf2ce6595d7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:35.181372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 434/872] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:35.195289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:35.318392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275376-396d-4dd3-9b71-f7e4dfe3189c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.319089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275376-396d-4dd3-9b71-f7e4dfe3189c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.319089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f275376-396d-4dd3-9b71-f7e4dfe3189c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.320556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 435/873] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:35.326637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.326918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.327188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.346654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:35.348032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:35.350984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4876f55-dcf0-457d-abce-1a57d41f6e91 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:35.403207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:35.403822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.404102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.404375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.405146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=1e26dcedde9c427c86879a5d1516305c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:35.405449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:35.406954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:35.415256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 439/874] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:35 2022] GET /identity/v3/role_assignments?user.id=1e26dcedde9c427c86879a5d1516305c&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:35.455094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 436/875] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:35.481065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:35.505812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:35.624399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d468d-24a6-429a-b5cc-c2ef5849d7c8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:35.669992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:35.670659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.670964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.671273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.672077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:35.673769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-dc4b3b6c-8896-4aab-95ee-5a4826d9b960 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:35.686847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:35.687976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:35.689783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:35.692519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 440/876] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:35.703456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:35.884386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25a15-0209-4091-b428-d71479908c69 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:35.887840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:35.898801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c58ee-5ad9-4c0d-9ce1-303b9c456c9a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.899288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c58ee-5ad9-4c0d-9ce1-303b9c456c9a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.899659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c58ee-5ad9-4c0d-9ce1-303b9c456c9a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.901403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 441/877] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:35.910136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.911361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.912072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.935596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:35.937632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:35.938184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:35.938345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:35.938525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:35.938784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:35.939424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:35.939729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:35.941507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:35.947859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 437/878] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:35.953754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:36.033290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 442/879] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:36.058410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:36.079793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:36.096180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d470d3-846d-4566-a686-6ece46b8146d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:36.153839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:36.155622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:36.156219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:36.157018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:36.157971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:36.158500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:36.160119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2ec3-f882-467b-836b-6a2b1005f9a9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:36.167938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 438/880] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:36.235887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317adc-9569-4c35-bb29-ecd5aa57383e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:36.291176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:36.292433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:36.293005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:36.293518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:36.294541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:36.296406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82106f07-8af2-4f27-9f34-c4fbd76dbd6f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:36.329323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 443/881] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:36 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:50:37.445308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a43c-f25a-4e67-a84c-119fd4cef3db None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.445993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a43c-f25a-4e67-a84c-119fd4cef3db None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.445993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a43c-f25a-4e67-a84c-119fd4cef3db None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.447457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 439/882] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:37.453066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.453587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.453587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.474410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:37.475797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:37.554643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:37.568300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 444/883] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:37.593186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a43c-f25a-4e67-a84c-119fd4cef3db None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:37.633487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:37.726222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a43c-f25a-4e67-a84c-119fd4cef3db None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:37.772304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:37.773048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.773323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.773637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.774243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:37.775758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1ac6a2ea-5f65-41d6-a0d0-6b962f09268f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:37.786298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:37.787829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:37.790281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 440/884] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:37.794768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:37.832299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225cf8-d6ec-44d2-9b47-05b4cd1745ea None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.833404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225cf8-d6ec-44d2-9b47-05b4cd1745ea None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.833828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6225cf8-d6ec-44d2-9b47-05b4cd1745ea None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.835645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 441/885] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:37.841641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.841957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.842261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.863758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:37.865752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:37.928981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5adc14-95b6-4f33-9798-6a8cd32de0a7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:37.961120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 442/886] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:37.973338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:37.974155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:37.974558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:37.974923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:37.975914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:37.976445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:37.978671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:37.982022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:37.988422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 445/887] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:37.997975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.010949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.096365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.120679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc23ad-5970-4e9d-8116-7b367f643661 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.152474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a841db-3fde-47ab-a380-9f468cdec259 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.168430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.169349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.169801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.170325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.182383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:38.187532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:38.188725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:38.189716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:38.196910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 443/888] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:50:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:38.198841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.199443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.200625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.201078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.201505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.202348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:38.202829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.204635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.212104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 446/889] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:38.221667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.327790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.351688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6a49d-11e2-4c2b-8cb4-58c725cbf507 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.370475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4995f-d2c1-40c3-bab5-00d7f81819e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.399086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.400220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.401214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.401841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.402381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.403652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:38.404133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.406482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.423055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.423055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.423055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.423055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.423520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] RBAC: Adding query filter params (interface=public, service_id=f64686c6ae134063a9e768164dce6a92, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:38.423520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.423726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 444/890] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:38.424426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.425016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.443688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 447/891] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/endpoints?service_id=f64686c6ae134063a9e768164dce6a92&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:38.445947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.571695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea561c-b166-49a8-81f4-ffb65ac29f5c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.576007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e281be3-7896-4b48-bf47-8981110ea0c8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.608823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.609361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.609634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.609903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.623551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.625143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.630327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.630943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.631225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.631498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.632666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.632895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.634330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fd919-efc6-4225-9d18-292b371f7ff5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.640763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 448/892] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 16:50:38.642098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e834-5d8c-4ef7-8c01-f0b01babf4de None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:38.642215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:38.643312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:38.644315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:38.644315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:38.644315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:38.644512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e834-5d8c-4ef7-8c01-f0b01babf4de None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.644512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e834-5d8c-4ef7-8c01-f0b01babf4de None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.653831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 449/893] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:38.654548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 445/894] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:38.655902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f0ba-bdf4-4a1b-988b-4fb11bd46f33 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.656197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f0ba-bdf4-4a1b-988b-4fb11bd46f33 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.656587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f0ba-bdf4-4a1b-988b-4fb11bd46f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.656948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.683078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7911f0ba-bdf4-4a1b-988b-4fb11bd46f33 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:38.685084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7911f0ba-bdf4-4a1b-988b-4fb11bd46f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:38.752337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:38.795086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 450/895] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:38.796719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0646-bb6e-4323-8176-efad023e7a32 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.797002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0646-bb6e-4323-8176-efad023e7a32 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.797257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0646-bb6e-4323-8176-efad023e7a32 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.799020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 451/896] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:38.810035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.810392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.810579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.815812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3fae6-3f3d-48da-b911-5fc5e54df535 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:38.834162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:38.835576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:38.863419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:38.865842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:38.866376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:38.866656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:38.867424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:38.867736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:38.869523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:38.882654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 446/897] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:38.883497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.944406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 452/898] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:38.946112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:38.955537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.006020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320359-b504-4b30-b2d0-86aa72a8861c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.046230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.046845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.047122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.047396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.048042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.049441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.068275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 447/899] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:38 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:39.069488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.111977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea0ca6-59bb-4cdb-a6e7-60002d9276c1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.137266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.181924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.183001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.183477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.183942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.193672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.195544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:39.214338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:39.215347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:39.216282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:39.216975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b28ff-30a8-4e6f-bb28-1c3b0c429045 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.219342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 453/900] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:39.225810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.240347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.263119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.264057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.264513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.264957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.265701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.267276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:39.279058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:39.280837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:39.282610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:39.286765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 448/901] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:39.287773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.373459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97fd5d-d08a-4207-b4a3-2beea177f00a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.425570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.425834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460871e6-ccc1-4bcb-bf4b-882b532900bc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.427065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.427425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.427759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.429016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:39.430337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.431884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.459708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 454/902] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:39.466433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.490676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.493103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.493576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.493998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.494852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:39.495303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.497138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.503921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 449/903] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:39.509756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.515656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.579634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.622179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fb1d4-f759-4c8d-8f82-56593d26c266 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.650079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a022-af86-4385-a287-cd9ea527bdc9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.680363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.681822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.682367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.682848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.693396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.694639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.694924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.695196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.695852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:39.696157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.697608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.708660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 450/904] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:39.711810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.773120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.774749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.805755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.870023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454edde-e628-4bde-a59d-9050df84903a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:39.883675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:39.898559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 455/905] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:39.901574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:39.921028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:39.921453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:39.921737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:39.922012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:39.922752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] RBAC: Adding query filter params (interface=public, service_id=8816ba90d5d64c2e9b56198268fc3a93, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:39.923062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:39.924474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:39.936074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/endpoints?service_id=8816ba90d5d64c2e9b56198268fc3a93&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:39.937137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:40.021492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0777e-6360-4c68-b779-53113c022da7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.052653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:40.063830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.064467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.064776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.065051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.079961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.082394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.084712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6804-dd6b-41f0-8904-76aae7f26655 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:40.101760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:40.102824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:40.103707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:40.103707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:40.103707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:40.108239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 456/907] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:40.109460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:40.132152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.133187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.133818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.134287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.135257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.136854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.144180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 452/908] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:39 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 16:50:40.245151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9d2d-c2e7-4a4e-828a-97ecb6c49da4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.290733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.291934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.292430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.293026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.293930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:40.294456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.296088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.313818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 457/909] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:40.320565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:40.381297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:40.455151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cf841-3046-4e15-9fa6-70b746ff8ae6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.500600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.501798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.502299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.502822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.510781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.512641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:40.526361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:40.527897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:40.529347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:40.531856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 453/910] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:40.538025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:40.595609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:40.687275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb73f4f-850f-4835-8556-512d7bafce28 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.746233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.747967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.748518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.749000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.749980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:40.750496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.753353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9587b-4020-4a94-9cd7-ab52d31262cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.777100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 458/911] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:40.785088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:40.916539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aca5f-088a-46f8-bbbd-524c1c3851c4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.916982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aca5f-088a-46f8-bbbd-524c1c3851c4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.917149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aca5f-088a-46f8-bbbd-524c1c3851c4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.919942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 459/912] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:40.924352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828cff-a810-471b-b3cf-9b3a91eea379 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.924734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828cff-a810-471b-b3cf-9b3a91eea379 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.925174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85828cff-a810-471b-b3cf-9b3a91eea379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.938636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:40.944008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2638c61-9e2c-44cf-825d-708fa5e99b81 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:40.952721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-85828cff-a810-471b-b3cf-9b3a91eea379 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:40.954473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-85828cff-a810-471b-b3cf-9b3a91eea379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:40.985330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa58295-d791-4676-9426-214efc23671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:40.986157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa58295-d791-4676-9426-214efc23671d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:40.986425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa58295-d791-4676-9426-214efc23671d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:40.986698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa58295-d791-4676-9426-214efc23671d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:40.987622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa58295-d791-4676-9426-214efc23671d None admin] RBAC: Adding query filter params (role.id=b64f5b52cccd4afab53f0c66d08c3a3e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=1e26dcedde9c427c86879a5d1516305c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:40.987933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa58295-d791-4676-9426-214efc23671d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:40.990391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa58295-d791-4676-9426-214efc23671d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:40.996422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 454/913] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:40 2022] GET /identity/v3/role_assignments?user.id=1e26dcedde9c427c86879a5d1516305c&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=b64f5b52cccd4afab53f0c66d08c3a3e => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:41.084795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 460/914] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:41.116563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa58295-d791-4676-9426-214efc23671d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.250812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa58295-d791-4676-9426-214efc23671d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.293588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.294219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.294493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.294759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.295344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.296729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.298082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c4b2-e2d1-45df-962f-00346ac55a4f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.298366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c4b2-e2d1-45df-962f-00346ac55a4f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.298641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c4b2-e2d1-45df-962f-00346ac55a4f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.300206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 461/915] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:41.305818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.306099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.306374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:41.306728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:41.307935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 16:50:41.309027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:41.310533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 455/916] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:41.318120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.324775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:41.326240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:41.350819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:41.359499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:41.423428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 462/917] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:41.446406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.451518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720a601-c0ec-48fc-bed5-34f5aa6ca4b3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.492440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.493172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.493525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.493866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.494582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:41.494955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.496397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.504968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 456/918] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:41.509761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.580366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae24b-7074-4514-80f9-0084da5b0f1d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.632317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.633010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.633389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.633761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.634524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.636069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:41.645550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:41.647024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:41.648073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:41.654758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 463/919] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:41.658390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.660224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:41.678304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943d94-0d84-48a5-8bbc-fb67b57592f6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.693990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:41.724072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.725010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.725464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.725881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.726771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:41.727270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.728808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.735026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 457/920] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:41.742095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.787932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04de05a-5510-413a-b7d9-c4acfd233ebc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.825542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.826294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.826667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.827053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.827784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:41.828184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.829752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.840772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 464/921] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:41.842112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:41.865399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68f723-7052-4557-808a-a3db372981b6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:41.913934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:41.915257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:41.915605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:41.915949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:41.916730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:41.919123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:41.949996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:41.956674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 458/922] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:41.974477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f43fc-9e69-47e6-b174-9456a7c10244 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:42.026043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:42.027116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.027586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.028124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.029208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:42.029708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:42.031509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:42.038642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 465/923] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:42.045744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:42.062182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:42.182758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c57e-5153-47f7-8d3a-19c5d252da3b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:42.221607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:42.222611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.223727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.224200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.225206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] RBAC: Adding query filter params (interface=public, service_id=ae127b7adad94b5b82f5126181386271, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:42.225697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:42.227259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588cc81-e866-4af6-b8cf-4e0be7b2c290 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:42.233848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 459/924] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:42 2022] GET /identity/v3/endpoints?service_id=ae127b7adad94b5b82f5126181386271&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:42.239821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:42.356704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753e9ab-85ea-43cb-93b7-213875204225 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:42.399966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:42.400621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.400906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.401178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.401788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:42.403167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb0a6-7bb6-415f-96dd-b17c4110b119 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:42.416645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 466/925] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:42 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 16:50:42.511292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357472-e9ce-4527-883d-a1a98f175bda None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.511490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357472-e9ce-4527-883d-a1a98f175bda None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.511754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31357472-e9ce-4527-883d-a1a98f175bda None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.513416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 460/926] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:42.519045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.519387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.519865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.541658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:42.543300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:42.546938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:42.635353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 467/927] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:42.669690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31357472-e9ce-4527-883d-a1a98f175bda None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:42.764727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:42.798260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31357472-e9ce-4527-883d-a1a98f175bda None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:42.838590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:42.839229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:42.839511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:42.839786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:42.840444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:42.841859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:42.855047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:42.856065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:42.857064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 461/928] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 10 16:50:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:42.864344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:42.980049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214fbaf-1c02-4bfe-9bb3-71dbfc738796 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:43.038122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:43.039535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.040268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.040991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.042307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:43.043118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:43.045629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:43.060956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 468/929] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:43.063336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:43.186343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74c18-1602-4139-a1bc-af0849e9238e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:43.225181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:43.225790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.226075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.226350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.227000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:43.227304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:43.228700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724779ec-ab65-43c2-91d2-30fa5484add6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:43.234500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 462/930] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:43.240023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:43.244534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:43.324636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcf9b-1769-4d06-9161-c50f326d9f53 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.325317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcf9b-1769-4d06-9161-c50f326d9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.325464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fcf9b-1769-4d06-9161-c50f326d9f53 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.327259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 463/931] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:43.333086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.333464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.333687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.340388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:43.354500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:43.355834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:43.405002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2fcbb-874e-40a6-9987-321b698aa81d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:43.440811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 464/932] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:43.455756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:43.462194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:43.463143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.463641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.464221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.465133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:43.466798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:43.496452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 469/933] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:50:43.605071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ff4d-ae65-4ba9-9856-95969df1105d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:43.644209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:43.657762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72097-800e-421a-9469-4c835a938914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:43.658403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72097-800e-421a-9469-4c835a938914 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.658817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72097-800e-421a-9469-4c835a938914 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.659098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72097-800e-421a-9469-4c835a938914 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.672299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a72097-800e-421a-9469-4c835a938914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-70a72097-800e-421a-9469-4c835a938914 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:43.678303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:43.679294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:43.680146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:43.684900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 465/934] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:50:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:43.686644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:43.767268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:43.819539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2389cb2-8687-4b33-b07b-203db017fe98 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:43.860174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:43.860748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:43.861110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:43.861573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:43.862704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:43.863235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:43.866284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:43.876187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 470/935] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:50:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:43.882556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72097-800e-421a-9469-4c835a938914 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.009486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72097-800e-421a-9469-4c835a938914 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.047707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.048343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.048660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.048936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.061660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.063128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:44.080261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:44.081724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:44.083186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:44.083186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:44.083186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:44.083186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 466/936] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:44.089873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.216007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa8688-12d9-413b-a668-4e7f0084ea39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.242453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:44.257795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.258426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.258711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.258986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.259647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:44.259951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.261360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389695a4-9a66-4216-af09-518c7ff97c40 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.275350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 471/937] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:44.281204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.319785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068036-4119-439b-9612-e978a4b4f3eb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.320128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068036-4119-439b-9612-e978a4b4f3eb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.320319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8068036-4119-439b-9612-e978a4b4f3eb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.322003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 472/938] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:44.329994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.330606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.331162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.338972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:44.358753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:44.360206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:44.457854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22782551-8517-4b16-9479-aaf015e81174 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.458490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 473/939] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:44.478202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.503607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.505363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.505873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.506316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.518840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.520764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:44.536684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:44.537682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:44.538619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:44.541146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 467/940] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:44.546960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.599789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cb863-0b61-4c5a-a523-0bb68d2c4353 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.615924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:44.640827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.641908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.642391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.642918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.643755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.645503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.648360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING keystone.server.flask.common [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 16:50:44.674003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 16:50:44.674003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 16:50:44.674003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [parameters: {'id': '59917f1c4d6a4d939be4a9e884abf7f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 16:50:44.674003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 16:50:44.690390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:44.694860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad357652-99b3-48eb-9542-1cfe1b941f9f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59917f1c4d6a4d939be4a9e884abf7f3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59917f1c4d6a4d939be4a9e884abf7f3. Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:50:44.702701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 16:50:44.703750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Aug 10 16:50:44.705006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 16:50:44.705992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 16:50:44.706920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:50:44.707894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'id': '59917f1c4d6a4d939be4a9e884abf7f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.709109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:44.710296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 59917f1c4d6a4d939be4a9e884abf7f3. Aug 10 16:50:44.711301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.713958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 474/941] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 10 16:50:44 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:44.720088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.735007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.735474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.735752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.736022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.736839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:44.737297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.740005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.765209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 468/942] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:44.766069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.845824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cca09-418a-4cfb-82f6-0220c7b9d21c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.884330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6b1d8-6bb4-422e-8ccc-c3cc285af276 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:44.890731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.891698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.892149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.892620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.903718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.905421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b89f0616-074a-4775-9a11-888a74ac3158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:44.922012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:44.923156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:44.924039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 475/943] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:44.925346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39215-8fc3-42e6-9090-c547ca50d93c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.925622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39215-8fc3-42e6-9090-c547ca50d93c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.925881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c39215-8fc3-42e6-9090-c547ca50d93c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.935502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 476/944] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:44.935502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c39215-8fc3-42e6-9090-c547ca50d93c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:44.937322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:44.938020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.938299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.938567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:44.953469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:44.956264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:44.970468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ec6f9020-9fdc-450f-81a2-55759389069b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:44.978134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:44.979152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:44.980070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:44.980070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:44.980070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:44.980070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 469/945] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:44.981846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:44.982419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:44.983000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.008157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:45.009295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:45.012219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.078784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c39215-8fc3-42e6-9090-c547ca50d93c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.093796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 470/946] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:45.105486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.119794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.120439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.120749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.121019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.121696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:45.121993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.123435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.142920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 477/947] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:45.143899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.271906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf4a6-bae7-46e2-aa9e-413afeff2dbf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.273694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.291909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02624368-01d8-4999-a34d-8ea2daaf4b3a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.332047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.332949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.334245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.334245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.334245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:45.334630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.336016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.343261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.343919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.344200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.344471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.345842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.347681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.351210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.355211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 471/948] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:45.362438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:45.363040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:45.365018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:45.365876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:45.368349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 478/949] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:45.375781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.506027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44287-7bc6-4fd8-bf59-5ec578099fb3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.528721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf09b29-e6b2-4694-bfb3-843106cae177 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.549173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.549805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.550086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.550404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.558827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.560285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:45.572918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:45.574678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:45.576052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 472/950] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:45.580516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.594230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.595629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.596166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.596900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.597716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:45.598888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.601274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.610681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 479/951] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:45.618096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.654731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.669125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.727444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7204b01-67f0-4009-ab30-6a1d0977a395 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.766461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.767075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.767394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.767623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.768319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:45.768678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.770716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.780004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbeb0d-cd90-4dc1-bcc4-68dc650e6199 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.791388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 473/952] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:45.792472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.827636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.828986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.829482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.829751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.830381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:45.830680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.832078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12cbc-51de-4451-825e-99edb37b466c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:45.843144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 480/953] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:45.843144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa41dc-b3f0-473c-aa79-62c0784b2219 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.843144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa41dc-b3f0-473c-aa79-62c0784b2219 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.843144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa41dc-b3f0-473c-aa79-62c0784b2219 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.843144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 481/954] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:45.847077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa41dc-b3f0-473c-aa79-62c0784b2219 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:45.940958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58befd61-6eb1-4f8e-90f3-dc00bd516afe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.948411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.969779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:45.973694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa41dc-b3f0-473c-aa79-62c0784b2219 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:45.991511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:45.992192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:45.992470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:45.992776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/1e26dcedde9c427c86879a5d1516305c/roles/b64f5b52cccd4afab53f0c66d08c3a3e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:45.996537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=1e26dcedde9c427c86879a5d1516305c, role_id=b64f5b52cccd4afab53f0c66d08c3a3e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:45.996537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c4eb1-7c11-47b0-9fcd-32239c2eb015 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:46.011354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 474/955] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:50:45 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/1e26dcedde9c427c86879a5d1516305c/roles/b64f5b52cccd4afab53f0c66d08c3a3e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:50:46.014604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:46.015272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:46.015551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:46.015879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:46.016601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:46.018091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:46.019475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:46.020217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:46.021243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:46.050861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 482/956] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:46.055260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:46.056537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:46.161206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 475/957] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:46.188194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:46.319497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf8beb-e519-4c12-a739-8f3942081c39 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:46.360131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:46.360811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:46.361094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:46.361369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:46.361970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:46.363367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:46.368164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:46.376224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:46.377457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:46.378380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 483/958] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:46.385611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:46.509095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46012d12-2a6e-48f6-9489-e1059e85bf01 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:46.518392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:46.555383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:46.556257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:46.556765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:46.557188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:46.558033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:46.558513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:46.560115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb7d1-5604-4ba6-a019-51d32360b1ba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:46.566187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 476/959] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:46.573769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:46.701460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b7893-0c62-44f2-98b3-59316a49b129 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:46.743123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:46.744295 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:46.744966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:46.745595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:46.746863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:46.747549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:46.750118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629835-a9ba-413e-a214-90da472140e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:46.756947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 484/960] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:47.418656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c10bc-0f4c-4d32-be6e-6203e26156cb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:47.419234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c10bc-0f4c-4d32-be6e-6203e26156cb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:47.419234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c10bc-0f4c-4d32-be6e-6203e26156cb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:47.420895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 477/961] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:47.428755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:47.429320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:47.429320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:47.451071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:47.452589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:47.531809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:47.543429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 485/962] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:47.570126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c10bc-0f4c-4d32-be6e-6203e26156cb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:47.694566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c10bc-0f4c-4d32-be6e-6203e26156cb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:47.741734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:47.742351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:47.742628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:47.742903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:47.743556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:47.745024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:47.747591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING keystone.server.flask.common [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 16:50:47.762647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 16:50:47.762647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 16:50:47.762647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [parameters: {'user_id': '5c288a1bd11c428c90fec5a1d8249971', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 16:50:47.762647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Aug 10 16:50:47.769344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:50:47.771521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 16:50:47.774528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 16:50:47.778242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 16:50:47.786315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 16:50:47.789640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'user_id': '5c288a1bd11c428c90fec5a1d8249971', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:47.792734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 16:50:47.795717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:47.800109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 478/963] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 10 16:50:47 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:47.801585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:47.963360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56b7dd-db6f-4688-9da4-9daeaf9fefa0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:48.026760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:48.028320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.029111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.029856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.044205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:48.047325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7b0232a2-8f33-46b4-a416-547ded0c2185 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:48.071913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:48.073810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 16:50:48.076681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:48.080613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 486/964] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:50:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:48.090876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:48.124768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:48.218839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b8da7-c046-4911-a76c-aedff9116c17 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:48.270820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:48.271821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.272324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.272847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.273773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:48.274279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:48.276111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347e6d0-d1ea-41fb-a12b-3f5d6523ac1b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:48.325537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 479/965] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:48.411565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eeb6b-0d88-49df-b0af-a61a1d5aefd6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.412415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eeb6b-0d88-49df-b0af-a61a1d5aefd6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.412940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6eeb6b-0d88-49df-b0af-a61a1d5aefd6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.414978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 487/966] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:48.421136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.422118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.422619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.446211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:48.448574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:48.524100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c77b-3ccc-474b-9b56-b6ff1d3ec460 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.524805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c77b-3ccc-474b-9b56-b6ff1d3ec460 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.524805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c77b-3ccc-474b-9b56-b6ff1d3ec460 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.526149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 488/967] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:48.535317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.536366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.537695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.542133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 480/968] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:48.564403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:48.566084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:48.568206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:48.596039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:48.643904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:48.672515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 489/969] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:48.695085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:48.703674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aba509-231e-4d55-8561-7f0871b70520 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:48.747576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:48.748208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.748643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.748792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.761096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:48.765826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:48.767103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:48.769434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 481/970] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:48.773902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:48.815056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3baa3-f961-4e4f-9041-4583eac9ac15 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:48.856085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:48.856768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.857053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.857327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.857942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:48.859315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:48.871561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:48.872644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:48.873576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:48.878085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 490/971] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:48.878785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:48.889631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:48.912714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece613d-dae6-4ed4-950a-68229fee0f08 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:48.938488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:48.963557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:48.964697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:48.965743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:48.965743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:48.966592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:48.967042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:48.968433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:48.986913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 482/972] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:48.988053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.008147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ea8fe-300f-466b-ac2b-77116d85c8e1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.046882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.047499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.047786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.048055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.048716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:49.049020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.050400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.063250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 491/973] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:49.064556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.135537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69f8f1-7bd1-453d-9c0f-5c2061497f6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.176669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.177051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.177331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.177604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.181823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7865e9-a049-4745-843b-2462328fd6a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.188420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.189906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.191763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.197983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6c5ed33b-df19-4ba5-8551-baac9d0c9578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:49.209289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:49.215429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 483/974] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361730c7-5e6a-48aa-aa65-57746f36dd78 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361730c7-5e6a-48aa-aa65-57746f36dd78 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361730c7-5e6a-48aa-aa65-57746f36dd78 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.216614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 484/975] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:49.217629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361730c7-5e6a-48aa-aa65-57746f36dd78 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.237642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.237642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.237642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.237642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.238082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:49.238082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.239367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e01b2-4bb7-46c2-acc7-20d703377a38 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.250026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 492/976] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:49.250026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.250026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.250026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.267332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:49.268565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:49.341556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 493/977] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:49.342412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.364772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361730c7-5e6a-48aa-aa65-57746f36dd78 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.403674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.404274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.404580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.404852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.405495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:49.405795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.407174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.420997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 485/978] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:49.421833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.460876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5dcb7-07bf-4888-be32-37d5164e4f48 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.469920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.494469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.501910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.502525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.502812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.503081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.503957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] RBAC: Adding query filter params (interface=admin, service_id=ae127b7adad94b5b82f5126181386271, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:49.504141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.505552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.512797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 494/979] 10.222.0.39 () {56 vars in 1249 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/endpoints?service_id=ae127b7adad94b5b82f5126181386271&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:49.513638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.542361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576633fe-f6ef-4f6e-9bbc-2215e8f2b9ca None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.578672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.579267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.579544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.579812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.580453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.581838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.599871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 486/980] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:49 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:49.600746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.655301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efe2-e590-4df8-921b-3191e3863dc7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.711367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.712024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.712306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.712607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.721779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.725687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:49.743614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:49.744710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:49.745674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 495/981] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:49.750948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:49.753807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225953e8-acfd-438b-b4f9-04e841825464 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.772582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.796697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.797543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.797679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:49.797774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.797849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.798433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.799977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.809050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 487/982] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/services => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 16:50:49.884908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f693359-2678-4901-b866-3b6b361d311e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:49.933815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0057726-f012-473b-802a-71422d524b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:49.934622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057726-f012-473b-802a-71422d524b00 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:49.935043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057726-f012-473b-802a-71422d524b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:49.935451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057726-f012-473b-802a-71422d524b00 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:49.936638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0057726-f012-473b-802a-71422d524b00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:49.937103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0057726-f012-473b-802a-71422d524b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:49.939381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0057726-f012-473b-802a-71422d524b00 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:49.963261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 496/983] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:49.968351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:50.078381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a72b7-337f-4bfd-9781-920e6b46435a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:50.118764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:50.119376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:50.119651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:50.119919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:50.168722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:50.193404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:50.194756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:50.303863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 488/984] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:49 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 16:50:50.305405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0057726-f012-473b-802a-71422d524b00 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:50.400521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:50.418593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0057726-f012-473b-802a-71422d524b00 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:50.453418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:50.453960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:50.454235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:50.454502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:50.466244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:50.467702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:50.483231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:50.484252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:50.493685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:50.493685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:50.493685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:50.493685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 497/985] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:50.494068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:50.580189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:50.604356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fade4f-da5d-45d7-bdc7-3cd4c0f7bbc7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:50.640816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:50.641739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:50.642165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:50.642586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:50.643369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:50.643818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:50.645626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:50.662524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 489/986] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:50.663895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:50.772437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3424-bb9e-401c-8a1e-684082f89787 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:50.815076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:50.816130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:50.817266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:50.817951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:50.821629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:50.826292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:50.828471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:50:50.841246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:50.842187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:50:50.843107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:50.844333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 498/987] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:50.848970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:50.962681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ef6c4-f86e-4fb8-bb6d-203bd9d89c27 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:51.000841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:51.001447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.001726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.001999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.002697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:51.003004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:51.005519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b21e6f-83b5-4e89-8ce0-e535870d151e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:51.013237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:51.024946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 490/988] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:51.025787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:51.132416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960533dc-bc89-40ea-bbd8-d94034afee2f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:51.168054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:51.168684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.168963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.169232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.169951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] RBAC: Adding query filter params (role.id=b64f5b52cccd4afab53f0c66d08c3a3e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=1e26dcedde9c427c86879a5d1516305c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:51.170255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:51.171680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d646f9-5848-4f96-8342-d213cc0f0879 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:51.184516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 499/989] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:50:51 2022] GET /identity/v3/role_assignments?user.id=1e26dcedde9c427c86879a5d1516305c&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=b64f5b52cccd4afab53f0c66d08c3a3e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:51.700036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6c30-9bf3-4702-93f0-c93425da968b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.700781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6c30-9bf3-4702-93f0-c93425da968b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.700862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6c30-9bf3-4702-93f0-c93425da968b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.702370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 491/990] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:51.708412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb71e-bdee-41e6-b1b3-ce2ecc2367c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.708871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb71e-bdee-41e6-b1b3-ce2ecc2367c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.709068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb71e-bdee-41e6-b1b3-ce2ecc2367c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.730186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5afeb71e-bdee-41e6-b1b3-ce2ecc2367c2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:51.731601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5afeb71e-bdee-41e6-b1b3-ce2ecc2367c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:51.790137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:51.804628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 500/991] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:51.826318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6c30-9bf3-4702-93f0-c93425da968b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:51.918597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6a6e-9b9a-4d5b-8699-21e8041ee7f7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.918932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6a6e-9b9a-4d5b-8699-21e8041ee7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.919158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb6a6e-9b9a-4d5b-8699-21e8041ee7f7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.921025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 501/992] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:51.925830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.926114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.926425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.946859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6c30-9bf3-4702-93f0-c93425da968b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:51.948042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:51.949815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:51.989554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:51.990349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:51.990627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:51.990896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:51.991496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:51.992951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:52.002284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:52.003468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:52.005390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 492/993] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:52.010781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.043594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 502/994] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:52.067223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.095663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.141084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f21de-c824-44b8-b4c0-fd84460eb210 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.182419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.183025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.183393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.183638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.184197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:52.184522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.185884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.188249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c1f27-c68f-44cd-b265-fe79d96ff667 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.191123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 493/995] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:52.196469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.212995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.229753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.230411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.230696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.230969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.231542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.232942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:52.242996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:52.244013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:52.244901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 503/996] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:52.249901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.311177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50a49-26b9-4b6d-8b43-97606a6791e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.342963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.355435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.356342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.356800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.357071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.357708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:52.358011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.359369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.362481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523690e-9b54-45fe-aea7-c9c4e871fc54 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.370484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 494/997] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:52.372658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.406528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.407138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.407414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.407684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.408304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:52.408646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.410041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.415075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 504/998] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:52.420767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.481575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.496020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e9907-8184-4557-bd1d-6bf3aeaf35e2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.537365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.538378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.538865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.539335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.540409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] RBAC: Adding query filter params (interface=public, service_id=3dc146bdf68d460288fec61e5d0dbcb2, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:52.540905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.541036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59301-ba10-423b-9fac-4c04d7a9879f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.542950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.550345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 495/999] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/endpoints?service_id=3dc146bdf68d460288fec61e5d0dbcb2&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:52.559244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.578455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.579073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.579353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.579626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.580258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:52.580592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.582004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.588368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 505/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:52.593269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:52.625655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.693576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813584b6-728c-4bdf-9781-c4afadfcc0e6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.712798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a218-bd37-4ec8-9e3f-df99770b623d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:52.727380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:52.732420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.733296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.733578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.733847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.734458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.736253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1b4cd-0908-432b-82df-e9efdf046291 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.743491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 496/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:52 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 16:50:52.750852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:52.751483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:52.751763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:52.752034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:52.752748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:52.755008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716325a8-91f7-45cd-a3ef-d5f1d07dd53e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:52.780618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 506/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:50:53.356646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887f93-17cd-4e8a-b33d-b936bdfd1166 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:53.357036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887f93-17cd-4e8a-b33d-b936bdfd1166 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:53.357237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887f93-17cd-4e8a-b33d-b936bdfd1166 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:53.358806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 497/1003] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:53.364712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:53.365055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:53.365334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:53.383544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:53.384773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:53.462399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 507/1004] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:53.484515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887f93-17cd-4e8a-b33d-b936bdfd1166 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:53.596189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887f93-17cd-4e8a-b33d-b936bdfd1166 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:53.615695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:53.634607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:53.635239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:53.635517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:53.635790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] PATH_INFO: `/v3/services/image` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:53.636368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:53.637827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:53.646564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:53.647578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:53.653879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 498/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 10 16:50:53 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:53.654694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:53.768254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:53.773399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a7b94-019a-4bfb-b64e-1dba704feed1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:53.812590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:53.813202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:53.813473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:53.813736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:53.814362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:53.814656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:53.816137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77ee32-c244-404c-a059-c0bb86347408 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:53.826937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 508/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:53.828215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:53.941181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1cfb-4aaf-45b9-970f-c1b58ad38397 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:53.984699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:53.985299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:53.985573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:53.985842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:53.986473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] RBAC: Adding query filter params (type=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:53.986771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:53.988531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f799f19-4b78-4e24-a1c4-f58c755a877d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:53.994014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 499/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:54.889025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093fa0-acf3-4ed8-a473-859022c04fd3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:54.889544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093fa0-acf3-4ed8-a473-859022c04fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:54.889624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef093fa0-acf3-4ed8-a473-859022c04fd3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:54.890962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 509/1008] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:54.896584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:54.897059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:54.897136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:54.916998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:54.918203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:54.923430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498662e-534b-44cc-b54d-f3a648fc2108 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:54.923710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498662e-534b-44cc-b54d-f3a648fc2108 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:54.923985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498662e-534b-44cc-b54d-f3a648fc2108 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:54.925495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 510/1009] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:54.932291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:54.932612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:54.932889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:54.955912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:54.957588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:54.965099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:55.000633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 500/1010] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:55.023885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.048510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 511/1011] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:55.073069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.145703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4af451-fc2d-4b62-a374-fce763cf3240 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.178759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:55.187509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.188058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823d312-a1e7-43ff-9898-bf646b0cb5a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.188166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.188395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.188690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.189267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.190621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:55.200008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:55.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 16:50:55.202324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:55.207769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 501/1012] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:50:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:55.208567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.227302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.227936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.228222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.228520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.229661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.231102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.233013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 512/1013] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:55.238950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.268294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:55.337880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835685d-6eaa-40a9-bff7-5ee06a7b61e6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.361222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fce6d8-df10-4c95-a268-2507ea0e4e29 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.374076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.374676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.374946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.375215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.375838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:55.376194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.377957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.388003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 502/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:55.388908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.411998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.412890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.413289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.413676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.414583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.416689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.451109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 513/1015] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:55 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:50:55.513145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465884f6-9c9f-44b7-89c7-5c06ea76dce1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.516422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:55.565618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.566280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.566566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.566845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.567602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:55.567914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.569358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069e4e3-e4cd-4af4-ab3f-2c8e684ec23e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.575347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 503/1016] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 10 16:50:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:55.582931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:55.601423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:55.706547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf04da-2bba-4bdb-a973-af10d7aff997 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:55.744087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:55.744733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:55.745018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:55.745284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:55.745956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:55.747354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34f452-5619-4a12-9afd-e07605aba084 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:55.769537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 514/1017] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:50:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:56.087643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0fdf-604b-4163-97b1-90f80901e0fd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:56.088148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0fdf-604b-4163-97b1-90f80901e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:56.088148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0fdf-604b-4163-97b1-90f80901e0fd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:56.089506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 504/1018] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:56.095391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934d5-ffd6-4ff2-9364-641622069ae1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:56.095920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934d5-ffd6-4ff2-9364-641622069ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:56.095920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363934d5-ffd6-4ff2-9364-641622069ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:56.115119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-363934d5-ffd6-4ff2-9364-641622069ae1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:56.116299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-363934d5-ffd6-4ff2-9364-641622069ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:56.181955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:56.196204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 515/1019] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:56 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:56.219610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0fdf-604b-4163-97b1-90f80901e0fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:56.330069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f0fdf-604b-4163-97b1-90f80901e0fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:56.367376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:56.367899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:56.368177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:56.368446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:56.369121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:56.370474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803364be-3747-45f7-a739-e7957abbbd72 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:56.396516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 505/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:50:56 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:57.600410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270003-851a-4abf-a1ea-d84c193063f1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:57.600977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270003-851a-4abf-a1ea-d84c193063f1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:57.600977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86270003-851a-4abf-a1ea-d84c193063f1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:57.602500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 516/1021] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:50:57.607932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:57.608456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:57.608456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:57.628408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:57.630213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:57.657850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:57.718379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 506/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:50:57.744556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270003-851a-4abf-a1ea-d84c193063f1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:57.849957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86270003-851a-4abf-a1ea-d84c193063f1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:57.884489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:57.885052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:57.885331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:57.885602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:57.886728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:57.888166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d3362-7ef6-49b2-822e-b0cbc9fdab01 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:57.896579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 517/1023] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:57.899985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:57.975972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cbf8a-2cee-4f0b-a04b-11a1840ad432 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:57.976308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cbf8a-2cee-4f0b-a04b-11a1840ad432 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:57.976546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cbf8a-2cee-4f0b-a04b-11a1840ad432 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:57.977949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 518/1024] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:57.983079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:57.983354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:57.983628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.001853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:58.003039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:58.009972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dc2c7-cb99-4798-ad6d-2aa7298cd6bd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.047361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.047969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.048241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.048542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.049192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:58.050753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:58.077373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 507/1025] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:50:57 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:50:58.077959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.092213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 519/1026] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:58.116949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.133597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.241851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef05c-d971-4f0d-bca9-f25acdc22d3d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.281451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.282090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.282376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.282654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.295929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:50:58.301259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:58.302346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:58.303197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 508/1027] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:58.308849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.418504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa7190-b1d3-427b-810c-8133c392dc53 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.455205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.455819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.456099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.456429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.457368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:58.457844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:58.459213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c1268-31a1-4275-9b33-56184ee56ea2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:58.472288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 520/1028] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:58.474806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.515134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37edd-343a-4ea9-89e8-e34b1c239130 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.515318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37edd-343a-4ea9-89e8-e34b1c239130 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.515599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d37edd-343a-4ea9-89e8-e34b1c239130 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.517009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 521/1029] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:50:58.523011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1351-5f38-4719-b743-a762091937bf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.523301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1351-5f38-4719-b743-a762091937bf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.523576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1351-5f38-4719-b743-a762091937bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.545027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-397d1351-5f38-4719-b743-a762091937bf None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:50:58.546248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-397d1351-5f38-4719-b743-a762091937bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:50:58.555244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.592959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ce5b-9dff-40f3-8e5b-9646be3344d1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.606062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.627975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 522/1030] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:50:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:50:58.632944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.633582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.633860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.634130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.647270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:58.648746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:58.654129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1351-5f38-4719-b743-a762091937bf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:58.670656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:58.671687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:58.673057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:58.673057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:58.673057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:58.673057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 509/1031] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:58.677806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.791329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1351-5f38-4719-b743-a762091937bf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.803927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071644-2b23-4113-a07d-b6256bf8a122 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.830763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.834486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.835296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.835569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.836164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.836804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:58.838648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:58.844018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:58.844656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:58.844940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:58.845213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:58.845864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:58.846168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:58.848621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:58.849044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:58.850018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:58.850885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 523/1032] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:58.856732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.867841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 510/1033] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:58.873896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:58.912604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:58.973886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf931654-a05a-4b2d-8080-6d3542e12a92 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:58.991609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071b2e-c7d7-4435-b513-7b099ce58b7b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.017817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.018444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.018733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.019007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.020259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:59.020680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.022103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.031712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 524/1034] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:59.032792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.044207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.044771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.045044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.045308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.054328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.055776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:50:59.068968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:59.070168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:50:59.071180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 511/1035] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:50:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:50:59.076194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.126120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.162713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00c1f3-eb95-4056-a270-bb6403290386 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.181168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.197421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32db08-64c8-487a-8d24-09ba2409cefe None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.210464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.211160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.211507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.211780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.212468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:59.212755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.214160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.219662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 525/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:59.228176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.235776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.236465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.236842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.237185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.238039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:59.238607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.240172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.264315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 512/1037] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:50:59.265462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.358198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66230d6-f4d8-4ef3-9521-5a55c1c880b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.387730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.392443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a449d1-9982-40d3-b40a-bf59564e04c2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.403110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.404138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.404510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.404716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.405759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] RBAC: Adding query filter params (interface=public, service_id=716849879aa340cdb8fd5628bf0ebcd0, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:50:59.406068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.407460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.418821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 526/1038] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/endpoints?service_id=716849879aa340cdb8fd5628bf0ebcd0&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:50:59.420447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.431418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.432180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.432596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.432967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.469542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.515341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.516945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.549219 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc4627-b096-4c18-be2e-f68d725c938f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.588499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.589068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.589343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.589612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.590217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.591599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.608619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 527/1039] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 16:50:59.637687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.645150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 513/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:50:59.648271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.786388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c86a99-5b28-4342-b977-d6c30266f44a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:50:59.789149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:50:59.827494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:50:59.828412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:50:59.828876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:50:59.829288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:50:59.842210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:50:59.843905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:50:59.859385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:50:59.860424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:50:59.861363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:50:59.861363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:50:59.861363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:50:59.861363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 528/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:50:59.867982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:50:59.981811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6d2e5-a251-4c5f-bf01-148748adb1c2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.020707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.021553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.021836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.022107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.022761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:00.023065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.024436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.037933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 514/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:00.042293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.158442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65c4c5-21fd-400b-a5b4-8f9bf93b482e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.208390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.209058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.209353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.209611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.217303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.218763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4c65cd40-68ca-47ea-9bbf-186ddb4cbb13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:51:00.231053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:00.232306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:00.233384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:00.234482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 529/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:00.238183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.272588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fb39-30ad-4caf-b683-905cb15e101f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.273305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fb39-30ad-4caf-b683-905cb15e101f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.273749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07fb39-30ad-4caf-b683-905cb15e101f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.275808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 530/1044] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:51:00.280922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.281243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.281522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.302582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:00.303787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:00.314602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:00.317682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:00.361906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23d258-3536-4596-ad66-7e77f1d8133f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.385147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 531/1045] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:51:00.405892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.406720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.407100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.407473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.408276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:00.409234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.410335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.414590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.431045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 515/1046] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:00.433170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.551476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bdc2a6-86e6-4e6a-acbe-a83aff04e4dc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.559389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f457a-f385-4424-958b-3399c846964d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.585167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:00.592924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.593554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.593834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.594104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.603305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.604303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.605121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.605466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.606271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] RBAC: Adding query filter params (role.id=b64f5b52cccd4afab53f0c66d08c3a3e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:00.606649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.607724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:00.608516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:00.612393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:00.614469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:00.615335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 532/1047] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:00.629340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 516/1048] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=b64f5b52cccd4afab53f0c66d08c3a3e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:00.629566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.631998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:00.748445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145067f-ab2f-4870-979d-47b26df1d169 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.791823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.793056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.793627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.794195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.795167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:00.795649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.797286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.811954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 533/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:00.813326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:00.932396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafd40-14b9-456d-97cc-0e8b851fe273 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:00.969071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:00.969624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:00.969900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:00.970170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] PATH_INFO: `/v3/users/2d23a800a2c448e887328bb25117aca7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:00.986132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] RBAC: Authorizing `identity:get_user(user_id=2d23a800a2c448e887328bb25117aca7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:00.987646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:00.990219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 517/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/users/2d23a800a2c448e887328bb25117aca7 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:00.996334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:01.077988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:01.118255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b7226-71cd-4e24-b100-0af01732b337 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:01.169595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:01.170565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:01.171000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:01.171420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:01.284403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:01.286184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:01.371731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:01.421916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 534/1051] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:01.423434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:01.480981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:01.542132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74c56-91df-4020-95fb-1daefa12704b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:01.577827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:01.578457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:01.578736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:01.579011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:01.580121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:01.581578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006f45c-76c6-448c-91c6-0de63c9526c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:01.583650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 518/1052] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:01 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:01.589531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:01.701607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016c6dc-5e2c-43e7-8e27-b00cb4c5106b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:01.740180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:01.740893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:01.740893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:01.741422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:01.742524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=6620eade78044d7da90cb5b7532a948f, user.id=2d23a800a2c448e887328bb25117aca7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:01.742841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:01.745025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06726a54-3dd2-4b09-b308-51c1365ddd6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:01.751964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 535/1053] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:01 2022] GET /identity/v3/role_assignments?user.id=2d23a800a2c448e887328bb25117aca7&scope.project.id=6620eade78044d7da90cb5b7532a948f&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:01.833734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62de4-f72e-4d4a-bdcf-c35817be657d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:01.834634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62de4-f72e-4d4a-bdcf-c35817be657d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:01.834634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62de4-f72e-4d4a-bdcf-c35817be657d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:01.837152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 519/1054] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:01.849398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:01.849898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:01.850396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:01.883642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:01.885335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:01.930256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:02.000330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 536/1055] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:02.025187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62de4-f72e-4d4a-bdcf-c35817be657d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:02.153018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62de4-f72e-4d4a-bdcf-c35817be657d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:02.169848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:02.209418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:02.210780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:02.211363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:02.211894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] PATH_INFO: `/v3/services/image` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:02.212993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:02.215080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:02.226842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:02.227992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 16:51:02.228877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:02.232647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 520/1056] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 10 16:51:02 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:02.235943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:02.393048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9fced-2b57-4862-85b9-703b42163bd0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:02.443982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:02.444884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:02.445348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:02.445800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:02.446860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:02.447335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:02.449655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:02.465806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 537/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:02.468945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:02.626968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3baac-dd5c-4928-9016-bac663a29b91 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:02.696245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:02.696894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:02.697237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:02.697517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:02.698174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] RBAC: Adding query filter params (type=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:02.698471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:02.699835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fe4c2-9553-4f48-8ae0-21c002689a42 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:02.711298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 521/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:02.713246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:02.752185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:02.863985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d9b49-4a3a-4c51-9823-a7d32b7a1a1b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:02.922449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:02.923519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:02.923803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:02.924225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:02.926257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:02.928569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95417-5cb4-4ecb-a58c-d54faef6e068 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:02.958161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 538/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:51:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:51:02.996273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e924c-e963-49c0-9412-b97ec6c5fbde None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:02.997114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e924c-e963-49c0-9412-b97ec6c5fbde None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:02.997293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e924c-e963-49c0-9412-b97ec6c5fbde None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:02.999160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 522/1060] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:03.005718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:03.006085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:03.006270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:03.027945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:03.029230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:03.149973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 539/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:03.174381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e924c-e963-49c0-9412-b97ec6c5fbde None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:03.224396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:03.295512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e924c-e963-49c0-9412-b97ec6c5fbde None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:03.347339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:03.348073 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:03.348537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:03.348817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:03.359883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:03.367993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:03.369258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:03.370115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 523/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:03.376844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:03.390087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:03.497747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcb3be-12ce-4115-9de9-72f5f004f0ed None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:03.536139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:03.536786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:03.537065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:03.537337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:03.538009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:03.538310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:03.539699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:03.555275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 540/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:51:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:03.557536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:03.694654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b53bc-0a6f-4811-b498-0fa04a7699e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:03.696237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:03.742654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:03.743292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:03.743571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:03.743839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:03.755480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:03.757655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:03.780932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:03.781960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:51:03.782904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:03.782904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:03.782904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:03.783636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 524/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:03.794859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:03.873820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:03.908955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282a401-5c7a-4880-ba47-e549051001d8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:03.948767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:03.949381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:03.949669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:03.949943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:03.950849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:03.951155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:03.952666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:03.968561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 541/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:03.971394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.087250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527276bb-8b85-4441-a558-a4bc9bb6d46b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.136722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.137632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.137915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.138181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.146908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.148354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-90cb9f78-dcc3-447e-a8f9-c2bb5f9deca4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:51:04.160083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:04.161154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:04.162129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 525/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:51:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:04.169547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.243337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d4a0-3008-4d0c-b663-94e0efe14140 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.244200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d4a0-3008-4d0c-b663-94e0efe14140 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.245639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d4a0-3008-4d0c-b663-94e0efe14140 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.247598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 526/1067] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:04.252678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.252965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.253232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.271918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:04.273144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:04.277733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.280363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25e238-3610-4ead-a86a-1ee4aba3ea73 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.317470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.326950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.327553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.327832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.328100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.328857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:04.329156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.330716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.353558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 542/1068] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:04.364520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.364736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 527/1069] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:51:04.383148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.484564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511d590-32d5-444e-982f-4629b99febb6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.516160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fefe8-7d15-4ebb-889b-fa08782c955b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.530318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.530951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.531232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.531617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.542537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.544252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.556041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.556731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.557015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.557455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:04.564508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:04.565660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:51:04.567613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:04.567613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:04.567613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:04.567823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.569164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 543/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:04.574068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:04.575099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:04.575866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:04.576993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:04.577868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 528/1071] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:04.584121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.647321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.731147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1484-4468-4dd3-991d-6bd89749f45f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.741191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2264e93-5325-42d7-b287-abe042947073 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.769866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.770581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.770859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.771125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.771771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:04.772074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.773503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.781342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.781942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.782216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.782483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.783146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:04.783444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.786159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.787555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 544/1072] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:04.793100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.795542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 529/1073] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:04.801845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.870425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.913582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe059-fcb5-41b5-8a88-a21441a8bfb8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.914881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:04.920872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292a53b-10a2-444c-99d6-d7727f0b5eae None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:04.952138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.952800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.953081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.953360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] PATH_INFO: `/v3/users/2d23a800a2c448e887328bb25117aca7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.954559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2d23a800a2c448e887328bb25117aca7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.955999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.963147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 530/1074] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/users/2d23a800a2c448e887328bb25117aca7 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:04.964063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:04.971533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:04.973099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:04.973099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:04.974100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:04.981652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:04.983105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:51:04.995394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:04.996393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:04.997376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 545/1075] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:05.002293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:05.090885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd67d2-0b7c-4593-a4ef-ea187bb578f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:05.120036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:05.126233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:05.126857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.127137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.127409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.129250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:05.129942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723db9b-1ba3-4c15-a46c-fb6657564892 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:05.131479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:05.133378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 531/1076] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:04 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:05.139065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:05.183868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:05.184397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.184704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.184975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.185673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:05.185973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:05.187405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:05.206135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 546/1077] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:05.208088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:05.231638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:05.274599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750a951-47cc-485d-b70b-f0d13aea1603 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:05.314854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:05.315546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.315833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.316254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f/users/2d23a800a2c448e887328bb25117aca7/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.318643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] RBAC: Authorizing `identity:create_grant(project_id=6620eade78044d7da90cb5b7532a948f, user_id=2d23a800a2c448e887328bb25117aca7, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:05.320071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e9516-6f90-4b20-b28f-8b8e1ac7bb8e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:05.324779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e04a-ad95-4baf-8831-89717c7809e9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:05.340121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 532/1078] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:51:05 2022] PUT /identity/v3/projects/6620eade78044d7da90cb5b7532a948f/users/2d23a800a2c448e887328bb25117aca7/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:51:05.365324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890a941-b800-4755-a366-6491726fc583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:05.366171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a941-b800-4755-a366-6491726fc583 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.366551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a941-b800-4755-a366-6491726fc583 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.366931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890a941-b800-4755-a366-6491726fc583 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/b64f5b52cccd4afab53f0c66d08c3a3e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.369446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890a941-b800-4755-a366-6491726fc583 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=ca316ae3b4d84309af586fbb5aa61dd7, role_id=b64f5b52cccd4afab53f0c66d08c3a3e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:05.371055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890a941-b800-4755-a366-6491726fc583 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:05.387595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 547/1079] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:51:05 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/ca316ae3b4d84309af586fbb5aa61dd7/roles/b64f5b52cccd4afab53f0c66d08c3a3e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:51:05.452912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d335-dc34-433c-8864-4a4d51d070d0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.453126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d335-dc34-433c-8864-4a4d51d070d0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.453425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80d335-dc34-433c-8864-4a4d51d070d0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.459023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 533/1080] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:51:05.465454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.465794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.466090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.490661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:05.491885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:05.573167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 548/1081] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:05.598042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d335-dc34-433c-8864-4a4d51d070d0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:05.668104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:05.715881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80d335-dc34-433c-8864-4a4d51d070d0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:05.751792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:05.752398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:05.752712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:05.752986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:05.827769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:05.829242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:05.890010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:05.952901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 534/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:05.954585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:05.968567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:06.070621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005a45-a728-4a40-bbee-525f94024c5a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:06.106464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:06.107092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:06.107539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:06.107813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:06.118631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:06.120081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-03d144e6-8b4d-4468-a8a5-37acd3446562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:06.134607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:06.140924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:51:06.141979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:06.141979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:06.141979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:06.141979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 549/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:06.142240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:06.245704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fed95-0740-47cd-8a45-f1b5a54e0e29 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:06.279476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:06.280071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:06.280348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:06.280644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:06.281271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:06.281568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:06.282919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb385-73b9-4b5e-afa4-a38eaf5b0417 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:06.300872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 535/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:07.466743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc2df-921d-4349-a5a0-19f1927f9de3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.467309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc2df-921d-4349-a5a0-19f1927f9de3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.467309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc2df-921d-4349-a5a0-19f1927f9de3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.468617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 550/1085] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:07.474119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.475113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.475213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.487443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f4fa-0743-4445-82e1-cb4908cabac9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.487758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f4fa-0743-4445-82e1-cb4908cabac9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.488113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787f4fa-0743-4445-82e1-cb4908cabac9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.489594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 551/1086] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:51:07.493843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:07.494676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.494958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.495076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:07.495227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.509447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:07.514111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:07.515280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:07.567611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 536/1087] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:07.572988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:07.584675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 552/1088] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:51:07.591254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:07.607657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:07.696089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184787bc-3920-4972-8717-3e0c9126edc0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:07.710903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89264c-4515-4ea1-85f3-e868b248abf8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:07.736383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:07.736975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.737258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.737538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.744954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:07.745586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.745867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.746138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.748440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:07.753156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:07.755709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:07.757191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 537/1089] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:07.762585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:07.763567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:07.770879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:07.772711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:07.773884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 553/1090] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:07.775245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:07.778444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:07.842814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:07.896198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2d31f-32e8-4b14-b89a-af4625ba6803 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:07.903793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1249b-3182-4a41-84f0-19b085dad1af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:07.939296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:07.939900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.940194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.940463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.941235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:07.941537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:07.942910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:07.943539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:07.944142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:07.944421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:07.944725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:07.945394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:07.945699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:07.947074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:07.952360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 538/1091] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:07.958717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 554/1092] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:07.959412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:07.963964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.044714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.074598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcebae-d1d2-44f6-b5fe-6007e18c9a14 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.083566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732c22-53b8-47e1-bdec-d9cd4bded965 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.090486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.114132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.114762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.115040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.115310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.122328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.122957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.123234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.123506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] PATH_INFO: `/v3/users/2d23a800a2c448e887328bb25117aca7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.124673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] RBAC: Authorizing `identity:get_user(user_id=2d23a800a2c448e887328bb25117aca7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.126090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.126318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.127681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 539/1093] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/users/2d23a800a2c448e887328bb25117aca7 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:08.127775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.134002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:08.142822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:08.144332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:51:08.145350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:08.145350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:08.145350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:08.145350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 555/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:08.149756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.242146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8dd3d-82d8-4ec8-894c-2844e87a58dc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.262834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27211067-1840-4dfe-8540-260d99cc9b50 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.279130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.279753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.280248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.280787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.290852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.298975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.299615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.299897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.300175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.301485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:08.301792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.303250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.315553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 556/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:08.321355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.348961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.355428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.356949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.424024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22382d-6e14-44c3-adc6-cfeabcfaf303 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.460313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.460967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.461249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.461515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.465062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 540/1096] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 16:51:08.468757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.470196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.470958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:51:08.484181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:08.485879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:08.486907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 557/1097] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:51:08.491242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.524916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.583709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.592600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfd8ad-f90f-4934-b542-828afe51a40f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.604281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a88f9-a4fc-4381-830d-41e5aab28b00 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.627854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.629336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.629658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.629949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.631419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.632868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.634539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 541/1098] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:08.641010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.641990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.642606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.642887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.643167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.643967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:08.644455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.645943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.664293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 558/1099] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:08.670024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:08.747344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a761-a59f-4972-8343-942ebc7f1927 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.755480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.778075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bc879-4c9b-4045-a8f5-2ac0a328f4b2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:08.783390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.783989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.784268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.785196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.785957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=6620eade78044d7da90cb5b7532a948f, user.id=2d23a800a2c448e887328bb25117aca7) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:08.786269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.787697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.793766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 542/1100] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/role_assignments?user.id=2d23a800a2c448e887328bb25117aca7&scope.project.id=6620eade78044d7da90cb5b7532a948f&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:51:08.813950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:08.814681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:08.814967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:08.815236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:08.832659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:08.892291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:08.893832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:08.997243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 559/1101] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 16:51:09.002961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:09.103497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31d0e-8e02-49d9-b551-6cda69d14b46 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:09.137460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:09.138081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:09.138359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:09.138631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:09.149348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:09.150729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:09.165507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:09.166589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:51:09.167467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:09.167467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:51:09.167467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:09.167467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 543/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:09.172439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:09.217857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:09.271742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f15f-e4e6-4533-9bfd-9d4a61be53ed None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:09.306776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:09.307383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:09.307662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:09.307931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:09.308594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:09.308896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:09.310253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:09.321937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 560/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:09.327848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:09.353455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:09.429499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db24d51-ff3a-4995-8326-333bcd04698e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:09.463072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:09.463690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:09.463966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:09.464237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:09.470783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:09.472384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:51:09.483422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:09.484341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:09.485426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 544/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:09.491095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:09.601708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a523-2cca-468c-a54d-b1ad65c673f7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:09.603942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:09.636058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:09.636683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:09.636959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:09.637227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:09.637906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:09.638208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:09.639616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fa379-2985-4b98-9078-d564a16407e9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:09.652748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 561/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:09.658043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:09.742083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:09.761336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e342d-9d83-42e8-877e-24feabd33776 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:09.794884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:09.795762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:09.796041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:09.796336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:09.797100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] RBAC: Adding query filter params (role.id=b64f5b52cccd4afab53f0c66d08c3a3e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=ca316ae3b4d84309af586fbb5aa61dd7) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:09.797406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:09.798879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda64924-6361-4e2a-aef5-f719967bf875 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:09.804686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 545/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:09 2022] GET /identity/v3/role_assignments?user.id=ca316ae3b4d84309af586fbb5aa61dd7&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=b64f5b52cccd4afab53f0c66d08c3a3e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:10.863839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200dbe8-3f28-49c0-a9c1-b85113f4afa2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:10.864403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200dbe8-3f28-49c0-a9c1-b85113f4afa2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:10.864403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200dbe8-3f28-49c0-a9c1-b85113f4afa2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:10.865873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 562/1107] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:10.871040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:10.871447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:10.871579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:10.895478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:10.896675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:10.963018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 546/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:10.992862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200dbe8-3f28-49c0-a9c1-b85113f4afa2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:11.093700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200dbe8-3f28-49c0-a9c1-b85113f4afa2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:11.127764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:11.128431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:11.128742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:11.129014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:11.130115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:11.131822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce1a2b-7566-4602-92aa-264557f93b75 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:11.133414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 563/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:11.139231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:11.216725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:11.243886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08c365-ea6f-4dac-8f3d-445b13bfe1c2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:11.284206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:11.285765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:11.286251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:11.286741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:11.287919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:11.290753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180591e3-0df9-4533-9c0f-6a002ce44857 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:11.316392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 547/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:51:11 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:51:13.395291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf3ab-78ad-42a1-a47d-da88d47d6f62 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:13.395853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf3ab-78ad-42a1-a47d-da88d47d6f62 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:13.395853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cf3ab-78ad-42a1-a47d-da88d47d6f62 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:13.397309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 564/1111] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:13.402496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:13.402903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:13.403049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:13.421372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:13.422534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:13.488191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 548/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:13.512209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf3ab-78ad-42a1-a47d-da88d47d6f62 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:13.543744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:13.614489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cf3ab-78ad-42a1-a47d-da88d47d6f62 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:13.650459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:13.651008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:13.651284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:13.651550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] PATH_INFO: `/v3/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:13.652947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] RBAC: Authorizing `identity:get_role(role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:13.654408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:13.656129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 565/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:13 2022] GET /identity/v3/roles/19aab39ee8c04f399191428b85e73932 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:13.663694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:13.726026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:13.766225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0981298-c49d-4a59-a8d2-512357c63ef2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:13.800634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:13.801243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:13.801518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:13.801788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] PATH_INFO: `/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:13.815163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] RBAC: Authorizing `identity:get_user(user_id=4137ef9a2d6b47b7afbb27f3603bd5ee)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:13.817178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:13.818764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 549/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:13 2022] GET /identity/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:13.824658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:13.918106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:13.921105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade25fa8-8015-46b1-8b70-b422e0851571 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:13.955038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:13.955633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:13.955910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:13.956202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:14.023070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:14.024533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:14.115665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:14.119633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 566/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:14.125256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:14.220758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcb069-6864-436d-acc9-c6dae2777fcf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:14.239908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:14.254096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:14.254701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:14.254975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:14.255241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:14.256326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:14.257755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820575b-22da-4c7a-8a98-dc10df02e2f7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:14.259338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 550/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:14 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:14.265345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:14.363266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf85e3-a63b-42ce-94f2-d7596ff1a70f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:14.395518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a791-7311-42a0-954c-d028029115fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:14.396125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a791-7311-42a0-954c-d028029115fe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:14.396394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a791-7311-42a0-954c-d028029115fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:14.396690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a791-7311-42a0-954c-d028029115fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:14.397402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a791-7311-42a0-954c-d028029115fe None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=6620eade78044d7da90cb5b7532a948f, user.id=4137ef9a2d6b47b7afbb27f3603bd5ee) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:14.397703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a791-7311-42a0-954c-d028029115fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:14.399109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a791-7311-42a0-954c-d028029115fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:14.404247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 567/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:14 2022] GET /identity/v3/role_assignments?user.id=4137ef9a2d6b47b7afbb27f3603bd5ee&scope.project.id=6620eade78044d7da90cb5b7532a948f&role.id=19aab39ee8c04f399191428b85e73932 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:16.681963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318efc1f-fa55-467d-a93c-7b5f8eda4ebf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:16.682660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318efc1f-fa55-467d-a93c-7b5f8eda4ebf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:16.682660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318efc1f-fa55-467d-a93c-7b5f8eda4ebf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:16.684109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 551/1118] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:16.689841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:16.690275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:16.690514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:16.716004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:16.717213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:16.778754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:16.790083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 568/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:16.813302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318efc1f-fa55-467d-a93c-7b5f8eda4ebf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:16.914404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318efc1f-fa55-467d-a93c-7b5f8eda4ebf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:16.947726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:16.948269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:16.948575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:16.948849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] PATH_INFO: `/v3/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:16.950481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] RBAC: Authorizing `identity:get_role(role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:16.951835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:16.953247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 552/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:16 2022] GET /identity/v3/roles/19aab39ee8c04f399191428b85e73932 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:16.959818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:17.057628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d7a6f-eba8-4204-8f90-edf6bdbe5d4a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:17.091818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:17.092445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:17.092750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:17.093015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] PATH_INFO: `/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:17.094103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] RBAC: Authorizing `identity:get_user(user_id=4137ef9a2d6b47b7afbb27f3603bd5ee)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:17.095519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:17.097193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 569/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:16 2022] GET /identity/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:17.103000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:17.158176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:17.202280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1d413-3bc7-4df7-9a57-d13e63dd6f2d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:17.235548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:17.236161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:17.236438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:17.236738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:17.237965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:17.239436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3f74e-b138-4896-8c4d-cb9dcca82dae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:17.241151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 553/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:17 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:17.247482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:17.318225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:17.365711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42c6ea-b408-4838-a759-c3fc65f58575 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:17.399423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:17.400066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:17.400345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:17.400643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f/users/4137ef9a2d6b47b7afbb27f3603bd5ee/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:17.402776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] RBAC: Authorizing `identity:create_grant(project_id=6620eade78044d7da90cb5b7532a948f, user_id=4137ef9a2d6b47b7afbb27f3603bd5ee, role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:17.404194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb7edf-41a6-46b5-b282-fa4a9fcd761c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:17.416425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 570/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:51:17 2022] PUT /identity/v3/projects/6620eade78044d7da90cb5b7532a948f/users/4137ef9a2d6b47b7afbb27f3603bd5ee/roles/19aab39ee8c04f399191428b85e73932 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:51:19.446248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21042-b620-4b92-b62e-5cecd0b8acf0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:19.446808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21042-b620-4b92-b62e-5cecd0b8acf0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:19.446902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a21042-b620-4b92-b62e-5cecd0b8acf0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:19.448173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 554/1124] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:19.453593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:19.453965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:19.454132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:19.473600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:19.474757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:19.540922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 571/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:19.564167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a21042-b620-4b92-b62e-5cecd0b8acf0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:19.663639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a21042-b620-4b92-b62e-5cecd0b8acf0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:19.686781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:19.698438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:19.699002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:19.699287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:19.699560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] PATH_INFO: `/v3/roles/19aab39ee8c04f399191428b85e73932` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:19.701239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] RBAC: Authorizing `identity:get_role(role_id=19aab39ee8c04f399191428b85e73932)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:19.702594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:19.703914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 555/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:19 2022] GET /identity/v3/roles/19aab39ee8c04f399191428b85e73932 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:19.711376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:19.764308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:19.811479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafb38-3b0c-4994-bb8a-270bf6cd2fd9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:19.845338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:19.845956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:19.846237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:19.846511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] PATH_INFO: `/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:19.847859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] RBAC: Authorizing `identity:get_user(user_id=4137ef9a2d6b47b7afbb27f3603bd5ee)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:19.849319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:19.850890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 572/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:19 2022] GET /identity/v3/users/4137ef9a2d6b47b7afbb27f3603bd5ee => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:19.856629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:19.954481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79edbb7-5701-412a-a0d9-a48567c2b4ac None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:19.987981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009529-f755-451e-b586-f15640029f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:19.988602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009529-f755-451e-b586-f15640029f89 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:19.988883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009529-f755-451e-b586-f15640029f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:19.989155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5009529-f755-451e-b586-f15640029f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:20.045376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:20.055103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5009529-f755-451e-b586-f15640029f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:20.056573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5009529-f755-451e-b586-f15640029f89 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:20.156605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 556/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:20.162834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:20.265215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35236dae-79df-4ea8-9fba-f1c83187fbe7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:20.284693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:20.301343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:20.301967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:20.302248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:20.302522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] PATH_INFO: `/v3/projects/6620eade78044d7da90cb5b7532a948f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:20.303621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] RBAC: Authorizing `identity:get_project(project_id=6620eade78044d7da90cb5b7532a948f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:20.305097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11c875-60dc-4bea-ad48-c6f86a751a1f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:20.306750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 573/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:20 2022] GET /identity/v3/projects/6620eade78044d7da90cb5b7532a948f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:20.312972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009529-f755-451e-b586-f15640029f89 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:20.411005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:20.420220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5009529-f755-451e-b586-f15640029f89 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:20.454071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:20.454765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:20.454916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:20.455183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:20.455894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] RBAC: Adding query filter params (role.id=19aab39ee8c04f399191428b85e73932, scope.project.id=6620eade78044d7da90cb5b7532a948f, user.id=4137ef9a2d6b47b7afbb27f3603bd5ee) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:20.456333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:20.457768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34198fa3-c2db-4094-85c3-bf2c2577a93c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:20.463336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 557/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:20 2022] GET /identity/v3/role_assignments?user.id=4137ef9a2d6b47b7afbb27f3603bd5ee&scope.project.id=6620eade78044d7da90cb5b7532a948f&role.id=19aab39ee8c04f399191428b85e73932 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:22.517114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90df3e-09dd-4b27-85c9-b448317dac9b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:22.517670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90df3e-09dd-4b27-85c9-b448317dac9b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:22.517670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90df3e-09dd-4b27-85c9-b448317dac9b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:22.519000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 574/1131] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:22.524265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:22.524702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:22.524837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:22.545099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:22.546278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:22.615234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 558/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:22.639149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90df3e-09dd-4b27-85c9-b448317dac9b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:22.744992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90df3e-09dd-4b27-85c9-b448317dac9b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:22.778855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:22.779396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:22.779676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:22.779951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:22.781105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:22.782537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db32a0-cc32-4c73-ad6f-977e4d52c6f1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:22.784722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 575/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:22.790598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:22.882418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:22.898388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd123c-38c0-472f-ae4c-085f22d606e1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:22.934273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:22.934867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:22.935142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:22.935407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:22.936095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:22.937540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f9c25-0f22-433a-851a-bd43f6b9ffbd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:22.967647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 559/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:51:22 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:51:25.055532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da8428-5585-4738-8075-e23dfffa5042 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:25.056029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da8428-5585-4738-8075-e23dfffa5042 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:25.056029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da8428-5585-4738-8075-e23dfffa5042 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:25.057358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 576/1135] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:25.062557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:25.062992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:25.063087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:25.082410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:25.083562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:25.147804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 560/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:25.172166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da8428-5585-4738-8075-e23dfffa5042 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:25.229122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:25.272608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da8428-5585-4738-8075-e23dfffa5042 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:25.309142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:25.309690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:25.309962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:25.310225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:25.311305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:25.312759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895e26d-1357-4d17-9a85-b6d7979be1f2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:25.314324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 577/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:25.320545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:25.386507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:25.420962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748ca02-6d6a-4a0b-ab97-8bddf61382ad None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:25.456807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:25.457431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:25.457708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:25.457978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:25.458642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:25.460074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81376da9-f742-4d14-9a68-d622be610f09 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:25.482939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 561/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:51:25 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:51:27.519812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f212d1-8ff3-46ea-a734-8a006291c9ae None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:27.520380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f212d1-8ff3-46ea-a734-8a006291c9ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:27.520380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f212d1-8ff3-46ea-a734-8a006291c9ae None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:27.521751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 578/1139] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:27.526981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:27.527357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:27.527534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:27.545204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:27.546374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:27.613953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 562/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:27.637713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f212d1-8ff3-46ea-a734-8a006291c9ae None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:27.736131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f212d1-8ff3-46ea-a734-8a006291c9ae None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:27.759221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:27.769974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:27.770528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:27.770800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:27.771065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:27.780732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:27.785922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:27.787169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:27.788259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 579/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:27.793163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:27.845543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:27.889519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612cef-50f9-4577-aa08-4e9eadc07914 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:27.922062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:27.922652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:27.922931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:27.923201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:27.923857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:27.924156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:27.926171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:27.933887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 563/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:27.939622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:28.038896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818da75-74e6-4cf9-bf73-ec795c7bbe48 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:28.072009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:28.072646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:28.072923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:28.073190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] PATH_INFO: `/v3/users/96f2e190c66a4513aab764a7711ddc3c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:28.086770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] RBAC: Authorizing `identity:get_user(user_id=96f2e190c66a4513aab764a7711ddc3c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:28.088192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:28.089776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 580/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:27 2022] GET /identity/v3/users/96f2e190c66a4513aab764a7711ddc3c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:28.095551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:28.194668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655c43-3ed6-4fb5-8f4e-b961b2851fa6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:28.211206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:28.229781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:28.230369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:28.230646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:28.230916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:28.298703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:28.300089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:28.395237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 564/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:28.401224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:28.443177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:28.499625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adba-a91c-4761-88cb-0a57f337c7cb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:28.533981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:28.534682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:28.534912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:28.535180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] PATH_INFO: `/v3/projects/437f29785ae347919ed94c798fda0e12` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:28.536315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] RBAC: Authorizing `identity:get_project(project_id=437f29785ae347919ed94c798fda0e12)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:28.537786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094c3e3-a912-4ede-8127-f21cd3b32d43 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:28.539399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 581/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:28 2022] GET /identity/v3/projects/437f29785ae347919ed94c798fda0e12 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:28.545554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:28.563279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:28.646815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3baac2-f744-4e7d-9cee-1cd04e4d4938 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:28.681185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:28.681782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:28.682085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:28.682355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:28.683077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=437f29785ae347919ed94c798fda0e12, user.id=96f2e190c66a4513aab764a7711ddc3c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:28.683381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:28.684827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e6082-1b81-4c88-b467-1da35ea074f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:28.693983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 565/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:28 2022] GET /identity/v3/role_assignments?user.id=96f2e190c66a4513aab764a7711ddc3c&scope.project.id=437f29785ae347919ed94c798fda0e12&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:30.754934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f816b-f657-421f-a573-5d0ac77e3191 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:30.755480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f816b-f657-421f-a573-5d0ac77e3191 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:30.755480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f816b-f657-421f-a573-5d0ac77e3191 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:30.756846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 582/1147] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:30.762058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:30.762466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:30.762602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:30.781826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:30.782988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:30.849333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 566/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:30.871451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f816b-f657-421f-a573-5d0ac77e3191 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:30.971870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f816b-f657-421f-a573-5d0ac77e3191 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:30.982425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:31.006437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:31.007056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:31.007341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:31.007612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:31.017409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:31.022670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:31.023805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:31.025221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 583/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:31.029861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:31.041504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:31.129122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bae47-2280-4df3-89d9-70d84b255b2e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:31.162107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:31.162704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:31.162981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:31.163253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:31.163910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:31.164215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:31.165607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:31.173367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 567/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:31.180177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:31.280255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245dfc-7be1-4066-8aa0-5c62ba96484a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:31.319233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:31.319887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:31.320163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:31.320431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] PATH_INFO: `/v3/users/96f2e190c66a4513aab764a7711ddc3c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:31.321574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=96f2e190c66a4513aab764a7711ddc3c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:31.323018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:31.324624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 584/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:31 2022] GET /identity/v3/users/96f2e190c66a4513aab764a7711ddc3c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:31.330950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:31.401760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:31.432473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab98f04-9f80-4400-b3f1-e9b62bbffc86 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:31.466026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:31.466839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:31.467119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:31.467385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] PATH_INFO: `/v3/projects/437f29785ae347919ed94c798fda0e12` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:31.468475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] RBAC: Authorizing `identity:get_project(project_id=437f29785ae347919ed94c798fda0e12)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:31.469918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663646eb-5b02-4947-9d26-f28a84b7dccc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:31.472536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 568/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:31 2022] GET /identity/v3/projects/437f29785ae347919ed94c798fda0e12 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:31.478400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:31.519138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:31.579647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b28339-55b5-4547-8c2f-4c923a5cf6a7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:31.614496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:31.615140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:31.615414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:31.615681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] PATH_INFO: `/v3/projects/437f29785ae347919ed94c798fda0e12/users/96f2e190c66a4513aab764a7711ddc3c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:31.617566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=437f29785ae347919ed94c798fda0e12, user_id=96f2e190c66a4513aab764a7711ddc3c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:31.618984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ffd8a-5c99-45d5-b32a-5aa61907c8d3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:31.632680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 585/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:51:31 2022] PUT /identity/v3/projects/437f29785ae347919ed94c798fda0e12/users/96f2e190c66a4513aab764a7711ddc3c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:51:33.638710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87bf7-1891-45de-a833-7730e87440e3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:33.639244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87bf7-1891-45de-a833-7730e87440e3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:33.639244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e87bf7-1891-45de-a833-7730e87440e3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:33.640653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 569/1154] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:33.646210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:33.646663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:33.646752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:33.664803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:33.665979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:33.733571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 586/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:33.757418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e87bf7-1891-45de-a833-7730e87440e3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:33.857418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e87bf7-1891-45de-a833-7730e87440e3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:33.890292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:33.890829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:33.891103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:33.891370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:33.898903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:33.902046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:33.906835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:33.907925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:33.909627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 570/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:33.914658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:33.942737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:34.015748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d6274-c38b-4e66-889f-b5000fa42388 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:34.050893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:34.051495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:34.051773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:34.052043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:34.052815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:34.053123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:34.054478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:34.062229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 587/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:34.068551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:34.166967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41977c50-9db6-40a1-b514-3490db6d3732 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:34.201015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:34.201638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:34.201918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:34.202192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] PATH_INFO: `/v3/users/96f2e190c66a4513aab764a7711ddc3c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:34.203307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] RBAC: Authorizing `identity:get_user(user_id=96f2e190c66a4513aab764a7711ddc3c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:34.204774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:34.207440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 571/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:34 2022] GET /identity/v3/users/96f2e190c66a4513aab764a7711ddc3c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:34.213071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:34.304707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:34.314973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ee5a-5061-41e5-9eea-aac15602a102 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:34.350274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:34.350880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:34.351161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:34.351434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:34.422643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:34.424041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:34.511967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:34.522924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 588/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:34.529233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:34.595932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:34.629736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81555a-bd5e-458f-ae06-141c84646173 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:34.663268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:34.663899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:34.664148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:34.664424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] PATH_INFO: `/v3/projects/437f29785ae347919ed94c798fda0e12` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:34.665588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] RBAC: Authorizing `identity:get_project(project_id=437f29785ae347919ed94c798fda0e12)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:34.667002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6e53-5c93-4d8a-8646-13fd50bc7855 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:34.668654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 572/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:34 2022] GET /identity/v3/projects/437f29785ae347919ed94c798fda0e12 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:34.674759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:34.773100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275936e3-3e5f-4c17-901d-7e1263e072d7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:34.806895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:34.807489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:34.807763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:34.808029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:34.808768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=437f29785ae347919ed94c798fda0e12, user.id=96f2e190c66a4513aab764a7711ddc3c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:34.809068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:34.810487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab890e-e9f8-43f9-b0d5-5eaf41e01bb4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:34.816705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 589/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:34 2022] GET /identity/v3/role_assignments?user.id=96f2e190c66a4513aab764a7711ddc3c&scope.project.id=437f29785ae347919ed94c798fda0e12&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:36.929094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5067-38b5-4680-bfb2-3d3bf19954b0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:36.929747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5067-38b5-4680-bfb2-3d3bf19954b0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:36.929747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5067-38b5-4680-bfb2-3d3bf19954b0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:36.930963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 573/1162] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:51:36.936393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:36.936899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:36.936997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:36.957607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:36.958724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:37.026164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:37.050479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 590/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:51:37.076709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca5067-38b5-4680-bfb2-3d3bf19954b0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:37.187580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca5067-38b5-4680-bfb2-3d3bf19954b0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:37.226798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:37.227284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:37.227606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:37.227830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:37.231504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:37.313670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:37.315179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:37.422887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 574/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:37.430531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:37.538281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b0d7-cdc8-455b-80f0-da518fcb8b11 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:37.574771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:37.575668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:37.575943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:37.576214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:37.583062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:37.584538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cc1dffd0-8ebe-49c7-b681-8a789d41dd18 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:37.595643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:37.597484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:37.599136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 591/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:51:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:37.604998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:37.642075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:37.715275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb69a4-b23a-447d-a65f-0a1d8cce9af3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:37.752107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:37.753183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:37.753555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:37.753825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:37.754539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:37.754842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:37.756202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e08cad-0363-4319-b1f0-fd0f7da30861 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:37.763869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 575/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 10 16:51:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:39.867283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71d01-d85f-4eeb-858c-3d28e0891b50 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:39.867848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71d01-d85f-4eeb-858c-3d28e0891b50 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:39.867848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df71d01-d85f-4eeb-858c-3d28e0891b50 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:39.869308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 592/1167] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:39.876565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23097ab6-b087-4c19-9460-d81cdeb8eea4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:39.877062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23097ab6-b087-4c19-9460-d81cdeb8eea4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:39.877156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23097ab6-b087-4c19-9460-d81cdeb8eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:39.897598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-23097ab6-b087-4c19-9460-d81cdeb8eea4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:39.898796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-23097ab6-b087-4c19-9460-d81cdeb8eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:39.981173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 576/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:40.004440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df71d01-d85f-4eeb-858c-3d28e0891b50 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:40.054751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:40.116181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df71d01-d85f-4eeb-858c-3d28e0891b50 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:40.151707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:40.152515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:40.152740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:40.153067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:40.153781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:40.155212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782748af-fb26-4cd2-817b-afd35fbaf545 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:40.184763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 593/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Wed Aug 10 16:51:40 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:51:42.342922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0692-e9eb-4fcd-ad30-e31aa33e38d1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:42.343552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0692-e9eb-4fcd-ad30-e31aa33e38d1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:42.343552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d0692-e9eb-4fcd-ad30-e31aa33e38d1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:42.344946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 577/1170] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:42.353942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:42.354452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:42.354792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:42.387512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:42.388891 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:42.470476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 594/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:42.495363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0692-e9eb-4fcd-ad30-e31aa33e38d1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:42.547732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:42.639000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d0692-e9eb-4fcd-ad30-e31aa33e38d1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:42.678233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:42.678850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:42.679131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:42.679399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] PATH_INFO: `/v3/domains/80b3d51a95724424a7923472f5138f58` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:42.691484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=80b3d51a95724424a7923472f5138f58)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:42.693000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba3495-cbba-4c2e-9fc6-4f1fd6925e55 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:42.694734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 578/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 10 16:51:42 2022] GET /identity/v3/domains/80b3d51a95724424a7923472f5138f58 => generated 267 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:42.701177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:42.739998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:42.814020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0dc8e-d276-4f87-9f08-23fe46842e79 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:42.851981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:42.852623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:42.852904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:42.853216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:42.854219 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:42.856344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18a488-b107-4808-8eb4-e4792574c0b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:42.887270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 595/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:51:42 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:51:45.067022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3625-464c-4c52-826a-cf9338a0381f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:45.067567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3625-464c-4c52-826a-cf9338a0381f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:45.067677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3625-464c-4c52-826a-cf9338a0381f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:45.069093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 579/1174] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:51:45.074814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:45.075566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:45.075647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:45.094336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:45.095531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:45.165983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 596/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:51:45.192604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3625-464c-4c52-826a-cf9338a0381f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:45.290559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:45.302284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3625-464c-4c52-826a-cf9338a0381f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:45.339247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:45.339781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:45.340052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:45.340318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] PATH_INFO: `/v3/domains/80b3d51a95724424a7923472f5138f58` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:45.341441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=80b3d51a95724424a7923472f5138f58)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:45.342853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcfe4c-e16f-403d-9bfd-8cbbbb4d3f7a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:45.344413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 580/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 10 16:51:45 2022] GET /identity/v3/domains/80b3d51a95724424a7923472f5138f58 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:45.351038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:45.369877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:45.458620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1244ed-e38b-4cb0-a433-6283746f55ab None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:45.493043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:45.493659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:45.493942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:45.494217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:45.494878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:45.496323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359bc83-2718-442d-8d4e-1654cdd6be4e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:45.519809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 597/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:51:45 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:51:47.591254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e298b2-f353-4ead-8a79-102d0501352d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:47.591793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e298b2-f353-4ead-8a79-102d0501352d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:47.591793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e298b2-f353-4ead-8a79-102d0501352d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:47.593150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 581/1178] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:47.599311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:47.599821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:47.599922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:47.625461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:47.626674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:47.700447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 598/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:47.724618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e298b2-f353-4ead-8a79-102d0501352d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:47.848656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e298b2-f353-4ead-8a79-102d0501352d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:47.889088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:47.889943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:47.890257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:47.890524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:47.902752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:47.907389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:47.909585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:47.911250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 582/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:47.915739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:47.917944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:48.026428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a9ca-50e8-46f8-aab3-7b0095c35449 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:48.066636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:48.067246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:48.067528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:48.067801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:48.068473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:48.068805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:48.070348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:48.080289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 599/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:48.086770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:48.108914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:48.198885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a84d1-8f1d-4f0e-9222-2f486317b261 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:48.235508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:48.236126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:48.236421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:48.236771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] PATH_INFO: `/v3/users/bce9c0e8b11a49bf8bf3245801943001` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:48.250880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] RBAC: Authorizing `identity:get_user(user_id=bce9c0e8b11a49bf8bf3245801943001)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:48.252954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:48.254878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 583/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:48 2022] GET /identity/v3/users/bce9c0e8b11a49bf8bf3245801943001 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:48.261008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:48.328430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:48.370097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7ac7f-0d25-4793-bed7-8ae0b8e701df None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:48.405897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:48.406494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:48.406768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:48.407034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:48.484843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:48.486938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:48.555735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:48.614849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 600/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:48.618559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:48.707033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:48.746574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce468568-7c61-4743-adc4-0677dc769252 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:48.782320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:48.782832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:48.783113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:48.783909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] PATH_INFO: `/v3/projects/cdb1ec83ef8f42118335ef5286864ec2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:48.785471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] RBAC: Authorizing `identity:get_project(project_id=cdb1ec83ef8f42118335ef5286864ec2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:48.786894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf497c-24cd-4784-b03c-60666d756caa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:48.788567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 584/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:48 2022] GET /identity/v3/projects/cdb1ec83ef8f42118335ef5286864ec2 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:48.794780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:48.914274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261c2c-debc-4631-b16d-f51b42b46358 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:48.951467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:48.952008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:48.952246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:48.952543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:48.953261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=cdb1ec83ef8f42118335ef5286864ec2, user.id=bce9c0e8b11a49bf8bf3245801943001) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:48.953560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:48.954977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8998fd3-b352-4052-9adb-953cd1909c07 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:48.961508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 601/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:48 2022] GET /identity/v3/role_assignments?user.id=bce9c0e8b11a49bf8bf3245801943001&scope.project.id=cdb1ec83ef8f42118335ef5286864ec2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:51.006788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dc07-a747-40c2-8ce2-3c2e90c67bc5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.007343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dc07-a747-40c2-8ce2-3c2e90c67bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.007343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140dc07-a747-40c2-8ce2-3c2e90c67bc5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.008856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 585/1186] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:51.014139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.014554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.014752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.033751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:51.034974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:51.059285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:51.105838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 602/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:51.129558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140dc07-a747-40c2-8ce2-3c2e90c67bc5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:51.245188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140dc07-a747-40c2-8ce2-3c2e90c67bc5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:51.282065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:51.282611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.282891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.283215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.294431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:51.300391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:51.301584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:51:51.302745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 586/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:51.308378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:51.409959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a09109-48f8-4b3e-a612-d782e592371c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:51.451525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:51.452128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.452402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.452694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.453357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:51.453875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:51.455022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:51.464186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 603/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:51.470240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:51.475384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:51.601902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e5625-f586-4e53-a47e-8a1a2dd5c715 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:51.643069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:51.643693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.643969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.644242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] PATH_INFO: `/v3/users/bce9c0e8b11a49bf8bf3245801943001` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.645428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] RBAC: Authorizing `identity:get_user(user_id=bce9c0e8b11a49bf8bf3245801943001)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:51.646857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:51.648448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 587/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:51 2022] GET /identity/v3/users/bce9c0e8b11a49bf8bf3245801943001 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:51.654582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:51.690340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:51.780710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582aa76-837b-4cbf-8575-bd610f2ea863 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:51.813672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:51.814289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.814621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.814986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] PATH_INFO: `/v3/projects/cdb1ec83ef8f42118335ef5286864ec2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.816092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] RBAC: Authorizing `identity:get_project(project_id=cdb1ec83ef8f42118335ef5286864ec2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:51.817533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d8102-f60c-49f4-b77f-f6952bf05132 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:51.819317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 604/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:51 2022] GET /identity/v3/projects/cdb1ec83ef8f42118335ef5286864ec2 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:51.826986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:51.898289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:51.930056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549236f-84e4-4bf9-8f90-7842d1a0b50a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:51.967194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:51.967848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:51.968125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:51.968388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] PATH_INFO: `/v3/projects/cdb1ec83ef8f42118335ef5286864ec2/users/bce9c0e8b11a49bf8bf3245801943001/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:51.970379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] RBAC: Authorizing `identity:create_grant(project_id=cdb1ec83ef8f42118335ef5286864ec2, user_id=bce9c0e8b11a49bf8bf3245801943001, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:51.973030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c1e03-9c7a-486b-afd1-aebb93faedae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:51.987967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 588/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:51:51 2022] PUT /identity/v3/projects/cdb1ec83ef8f42118335ef5286864ec2/users/bce9c0e8b11a49bf8bf3245801943001/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:51:53.984982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07819c-2ce9-4773-b606-09aed1482a4b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:53.985495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07819c-2ce9-4773-b606-09aed1482a4b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:53.985495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07819c-2ce9-4773-b606-09aed1482a4b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:53.987420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 605/1193] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:51:53.992748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:53.993167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:53.993277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:54.011876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:51:54.013067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:51:54.082676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 589/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:51:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:51:54.105628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07819c-2ce9-4773-b606-09aed1482a4b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:54.196080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:54.209674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07819c-2ce9-4773-b606-09aed1482a4b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:54.245537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:54.246085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:54.246359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:54.246626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:54.258314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:51:54.262889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:51:54.263986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:51:54.265156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 606/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:51:54.270355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:54.331761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:54.371026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804165c-a490-405a-b4d7-2ef420f5ba64 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:54.404380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:54.405016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:54.405293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:54.405562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:54.406223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:54.406642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:54.408007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:54.416868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 590/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:54.422698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:54.523943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e669e-aead-476a-a075-a0f7dff088f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:54.558546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:54.559171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:54.559449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:54.559722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] PATH_INFO: `/v3/users/bce9c0e8b11a49bf8bf3245801943001` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:54.560912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] RBAC: Authorizing `identity:get_user(user_id=bce9c0e8b11a49bf8bf3245801943001)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:54.562353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:54.564015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 607/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 10 16:51:54 2022] GET /identity/v3/users/bce9c0e8b11a49bf8bf3245801943001 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:54.569981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:54.669487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a7733-2482-4aed-8b31-e3b9f0476087 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:54.693180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:54.705751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:54.706401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:54.706686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:54.706963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:54.782515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:54.784522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:54.887206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 591/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:51:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:51:54.894272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:54.913969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:55.021011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cff9f9-fed0-4fc5-b670-5bbd9beaa046 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:55.076202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:55.079290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:55.083547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:55.084111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] PATH_INFO: `/v3/projects/cdb1ec83ef8f42118335ef5286864ec2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:55.085894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] RBAC: Authorizing `identity:get_project(project_id=cdb1ec83ef8f42118335ef5286864ec2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:55.088005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c30f6-17b2-42d6-886e-194fa1bbc03e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:55.090613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 608/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 10 16:51:54 2022] GET /identity/v3/projects/cdb1ec83ef8f42118335ef5286864ec2 => generated 361 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:51:55.098055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:51:55.133184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:51:55.218239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc031e-585d-41eb-89d6-c75eed7863cc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:51:55.253136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:51:55.253723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:51:55.253996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:51:55.254264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:51:55.255026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=cdb1ec83ef8f42118335ef5286864ec2, user.id=bce9c0e8b11a49bf8bf3245801943001) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:51:55.255327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:51:55.256748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51394-ca43-4a97-ab26-008e0d234944 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:51:55.262440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 592/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:51:55 2022] GET /identity/v3/role_assignments?user.id=bce9c0e8b11a49bf8bf3245801943001&scope.project.id=cdb1ec83ef8f42118335ef5286864ec2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:05.068457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=58 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:05.259813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=56 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:52.445570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaae35-b1c4-41eb-a0a2-75ea78a52a26 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:52.446190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaae35-b1c4-41eb-a0a2-75ea78a52a26 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:52.446190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaae35-b1c4-41eb-a0a2-75ea78a52a26 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:52.447493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 609/1201] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:52:52.454198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:52.454744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:52.454858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:52.481826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:52:52.484309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:52:52.580428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 593/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:52:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:52:52.610681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaae35-b1c4-41eb-a0a2-75ea78a52a26 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:52.751785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aaae35-b1c4-41eb-a0a2-75ea78a52a26 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:52.800033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:52.800898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:52.801226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:52.801486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:52.818301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:52.820051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:52:52.842684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:52.844677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:52:52.845802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:52:52.845802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:52.845802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:52:52.845802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 610/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:52:52.851950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:53.007017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020a58-6d31-466d-9836-2eb6f853f7e3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:53.057953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:53.073193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:53.074180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:53.074609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:53.075415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:53.076454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:53.076967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:53.079996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdc76c-38e1-4412-9f03-dfe5b44d3085 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:53.099801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 594/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:53.107559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:53.175422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:53.227342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4cf62-72e6-425b-96f3-438bf47be404 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:53.270256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:53.270797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:53.271091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:53.271347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:53.271988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:53.273468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460befb6-4aad-41c4-9148-75fed70d732b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:53.303327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 611/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 10 16:52:53 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:52:55.601237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009986-f668-405e-9762-e76f46db225b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:55.601815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009986-f668-405e-9762-e76f46db225b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:55.601934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009986-f668-405e-9762-e76f46db225b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:55.603347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 595/1206] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:52:55.608859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:55.609372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:55.609463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:55.628772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:52:55.630000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:52:55.708752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 612/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:52:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:52:55.731620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009986-f668-405e-9762-e76f46db225b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:55.858194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009986-f668-405e-9762-e76f46db225b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:55.903240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:55.903875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:55.904151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:55.904417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:55.917113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:52:55.922456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:55.923510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:52:55.925601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 596/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:52:55.929782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:55.975049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:56.053506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19766c-0db9-4e33-8c31-90730c8a1ebd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:56.092603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:56.093252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:56.093521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:56.093786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:56.094844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:56.095129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:56.096650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:56.112055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 613/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:56.113219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:56.177279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:56.236069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10615f3-5f6b-41fa-96f4-b57ce46c4de6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:56.278787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:56.279445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:56.279722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:56.279992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:56.291555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:56.293205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:52:56.311555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:56.318718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:52:56.320863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:52:56.320863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:56.320863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:52:56.320863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 597/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:52:56.322774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:56.439160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:56.443439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df39e8-dc97-4324-bb85-b7eeea367437 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:56.488767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:56.489578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:56.489959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:56.490331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:56.492888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:56.492888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:56.492888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:56.506839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 614/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:56.512637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:56.627457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d152cfd-6ae5-4185-ad5e-a549b516075f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:56.629084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:56.669013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:56.669948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:56.670346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:56.670826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:56.681933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:56.683800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:52:56.705008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:56.706188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:52:56.707158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 598/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:52:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:52:56.713022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:56.830799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049b40-4075-45f0-9173-f6b38caf41ca None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:56.870355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:56.871002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:56.871251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:56.871522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:56.872268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:56.872640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:56.874370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:56.894929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 615/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:52:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:56.900969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:57.034935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11e83a-af59-406e-ac6a-b48d5185b2e4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:57.079226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:57.079873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:57.080212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:57.080503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:57.116957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:57.160979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:57.162473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:57.289703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 599/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:52:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:52:57.297610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:57.323034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:57.425482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ed1e-1e4e-438b-8997-231be52ff268 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:57.469941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:57.470678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:57.471043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:57.471383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:57.485805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:57.487662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:52:57.506902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:52:57.509336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:52:57.509336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:52:57.509336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:52:57.512881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 616/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:52:57.513713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:57.585860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:57.634875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180d3c-d626-4ae5-8aca-2287bfea0ffc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:57.678169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:57.678785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:57.679063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:57.679334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:57.679998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:57.680302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:57.681728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:57.701572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 600/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:52:57.703980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:57.788301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:57.824022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1dc0c-8260-4406-b125-b14402b7a74f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:57.862134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:57.862793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:57.863111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:57.863376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:57.871371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:57.873113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:52:57.887280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:52:57.888395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:52:57.889723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 617/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:52:57.895671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:58.011990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35ea53-17aa-45b1-82ff-f723955ebde7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:58.042703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:58.060982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:58.061411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:58.061687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:58.062480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:58.063319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:58.063678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:58.065187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf8703-a4b4-4da7-9cbc-55bde5f434c3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:58.081149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 601/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:52:58.087306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:52:58.213850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a412c-6afb-4d1b-801e-a9e279be30b4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:52:58.248687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:52:58.256653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:52:58.257275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:52:58.257552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:52:58.257819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:52:58.258551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:52:58.258853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:52:58.260285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b07c6-cbac-432a-8310-dd5b3f90c93d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:52:58.266985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 618/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:52:58 2022] GET /identity/v3/role_assignments?user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:00.470027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61c238-9c9b-4d4f-8ffd-48910e3351bd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:00.470861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61c238-9c9b-4d4f-8ffd-48910e3351bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:00.470861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61c238-9c9b-4d4f-8ffd-48910e3351bd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:00.472008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 602/1220] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:00.477718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:00.478591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:00.478591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:00.497458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:00.498806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:00.571827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 619/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:00.595969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61c238-9c9b-4d4f-8ffd-48910e3351bd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:00.731611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61c238-9c9b-4d4f-8ffd-48910e3351bd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:00.770055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:00.770681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:00.770959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:00.771225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:00.782264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:53:00.787517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:00.788728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:00.790007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 603/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:53:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:00.794745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:00.923372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024000f-7a5e-4d2e-a481-40dfeae293a0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:00.952096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:00.964355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:00.964999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:00.965284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:00.965559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:00.966234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:00.966537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:00.968040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:00.977617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 620/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:00.984768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:01.043027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:01.111190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f5793-0982-4826-a2e0-d333c99dcbe1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:01.153765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288554-8827-4322-b51b-6024ee637745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:01.154536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288554-8827-4322-b51b-6024ee637745 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:01.154972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288554-8827-4322-b51b-6024ee637745 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:01.155692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288554-8827-4322-b51b-6024ee637745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:01.166260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288554-8827-4322-b51b-6024ee637745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:01.167702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288554-8827-4322-b51b-6024ee637745 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-20288554-8827-4322-b51b-6024ee637745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:01.183063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:01.184305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:01.185576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:01.185576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:01.185576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:01.185576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 604/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:01.191110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:01.309292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ce68-09c1-4684-bc58-61868a57717d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:01.355945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:01.356588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:01.356873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:01.357170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:01.357819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:01.358123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:01.360127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:01.373234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 621/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:01.382747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288554-8827-4322-b51b-6024ee637745 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:01.493945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:01.501336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288554-8827-4322-b51b-6024ee637745 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:01.538516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:01.539559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:01.539751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:01.540049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:01.550157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:01.551695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:53:01.564849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:01.566037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:01.567152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 605/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:01.572615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:01.627398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:01.693463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bec42-4041-44f3-8b54-5768090367aa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:01.744795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:01.745462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:01.745740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:01.746005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:01.746739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:01.747039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:01.748695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:01.768225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 622/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:53:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:01.774398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:01.897679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902410cb-4528-404e-816f-1c30f17c334b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:01.935777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:01.936406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:01.937411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:01.937640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:01.949461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:01.951194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:01.966641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:01.968043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:01.969851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:01.969851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:01.969851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:01.969851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 606/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:01.977655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:02.097530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf5b5-9e8c-416f-b668-b2f50586f8b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:02.100649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:02.146354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:02.147355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:02.147873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:02.148266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:02.149328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:02.149758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:02.152136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:02.175429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 623/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:02.181419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:02.195636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:02.309992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbabe3-c4bb-4e13-a105-1bf41303e7a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:02.349738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:02.350411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:02.350789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:02.351118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:02.359679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:02.361361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:53:02.375174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:02.376395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:02.377627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 607/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:02.382497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:02.512255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b5d16-5bc9-4e04-becc-d85e815fe59d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:02.563576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:02.564242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:02.564609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:02.564915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:02.565666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:02.565967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:02.567548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ff59f-bbec-4b85-8d77-0f751e1e919c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:02.582908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 624/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:02.589322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:02.671107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:02.729779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b26f-3f01-429b-a984-c637ce2e15cd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:02.770296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:02.770847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:02.771124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:02.771421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fa5c3ba51f2c4d5583dbd3ebbafed5ff/roles/5677bef0d183442dbbc278a54f624b85` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:02.787593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=fa5c3ba51f2c4d5583dbd3ebbafed5ff, role_id=5677bef0d183442dbbc278a54f624b85)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:02.789266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7cb38-f86c-4fd1-adad-c90bcafd72c9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:02.803498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 608/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:53:02 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fa5c3ba51f2c4d5583dbd3ebbafed5ff/roles/5677bef0d183442dbbc278a54f624b85 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:53:05.078796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e16d-85b4-41ac-84cf-1f3a80a5aa44 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:05.079358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e16d-85b4-41ac-84cf-1f3a80a5aa44 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:05.079646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0e16d-85b4-41ac-84cf-1f3a80a5aa44 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:05.081294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 625/1233] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:05.087050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:05.087575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:05.087575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:05.108328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:05.110480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:05.185459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 609/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:05.211476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0e16d-85b4-41ac-84cf-1f3a80a5aa44 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:05.244395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:05.341799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0e16d-85b4-41ac-84cf-1f3a80a5aa44 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:05.384258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:05.385027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:05.385207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:05.385478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:05.397954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:53:05.402695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:05.403662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:05.404605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 626/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 10 16:53:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:05.410576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:05.471125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:05.535558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189bae4-79d8-420a-94a9-7945f1fe1850 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:05.576050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:05.576926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:05.577946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:05.578455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:05.579446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:05.580087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:05.581791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:05.595554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 610/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 10 16:53:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:05.601480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:05.713045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:05.733262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d55264-9a96-41d4-8e3f-de913897181e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:05.777586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:05.778359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:05.778721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:05.779069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:05.792737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:05.794655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:05.817231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:05.818647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:05.819765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:05.819765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:05.819765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:05.827804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 627/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:05.829233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:05.969439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e33cc7-0b66-4bbf-837c-8019e35590f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:05.982252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:06.017491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:06.018299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:06.018664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:06.019004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:06.019774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:06.020081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:06.021692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:06.038211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 611/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:06.045666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:06.166360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db36cb-7160-4f78-802e-28edfa34f0af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:06.205770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:06.206503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:06.206787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:06.207061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:06.209951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:06.215743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:06.217354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:53:06.231363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:06.232452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:06.233571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:06.236696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 628/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:06.238492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:06.368727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e94ac7-59ac-4131-80d3-8be4a9802e06 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:06.412734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:06.413474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:06.413774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:06.414114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:06.415060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:06.415430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:06.417140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:06.445846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 612/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:53:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:06.453942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:06.586026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58f53-7100-43fa-83aa-032a52d26dc8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:06.630632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:06.631304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:06.631608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:06.631914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:06.720115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:06.732508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:06.736274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:06.869912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 629/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:53:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:53:06.877462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:06.930191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:07.028687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899eef-d3b3-4b4e-a156-c856866f645b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:07.076183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:07.076843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:07.077679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:07.078188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:07.090696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:07.092433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:07.110535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:07.117205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:07.119281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:07.119281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:07.119281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:07.119281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 613/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:07.119694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:07.256386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:07.265021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ab84c-2039-48dc-981a-e22dbfcd82c6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:07.320843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:07.321471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:07.321746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:07.322030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:07.322686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:07.322979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:07.324372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:07.341787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 630/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:07.350501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:07.459809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:07.496763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab1ef-fe37-422e-90af-d04ca7c1b342 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:07.536347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:07.536906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:07.537182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:07.537453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:07.545593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:07.547258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:53:07.564392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:07.571653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:07.572729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 614/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:07.576243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:07.715547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352f911-9dd8-46b0-a8d4-d79eb29db5da None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:07.758423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:07.759042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:07.759319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:07.759588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:07.760321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:07.760621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:07.762335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fc49a-f62f-4cd5-86c3-0a7ea327b64b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:07.777189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 631/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:07.784128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:07.924343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5b7c5-367b-4695-9ddb-40ea06cfe2de None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:07.972387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:07.973095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:07.973360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:07.973706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:07.974472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] RBAC: Adding query filter params (role.id=5677bef0d183442dbbc278a54f624b85, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:07.974822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:07.976234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bea7-44b0-4440-ac3b-2095e6e1f70e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:07.985104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 615/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:53:07 2022] GET /identity/v3/role_assignments?user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=5677bef0d183442dbbc278a54f624b85 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:10.265920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1849f-46ad-48e2-b164-ea81344140b7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:10.266630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1849f-46ad-48e2-b164-ea81344140b7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:10.266630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1849f-46ad-48e2-b164-ea81344140b7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:10.267940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 632/1247] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:53:10.275539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:10.276075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:10.276075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:10.283514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:10.297466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:10.299074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:10.400131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 616/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:10.429312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1849f-46ad-48e2-b164-ea81344140b7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:10.460461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:10.586135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1849f-46ad-48e2-b164-ea81344140b7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:10.644412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:10.645425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:10.645911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:10.646353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:10.663861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:53:10.672146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:10.673487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:10.675001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 633/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:10.681508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:10.847178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97a77-9d9f-4e6c-8f1f-b9d5c82298bb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:10.890659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:10.899421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:10.900292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:10.900578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:10.901004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:10.902127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:10.902430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:10.904159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:10.920656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 617/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:10.928235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:11.034648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:11.064940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e5079-faef-4e0b-8c0c-eefc69523ac4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:11.109794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:11.110355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:11.110638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:11.110905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:11.129687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:11.131522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:11.151264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:11.152409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:11.153394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:11.153394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:11.153394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:11.153394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 634/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:11.158436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:11.299257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e43-9bd0-4d3c-8027-26db4d2386ed None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:11.348593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:11.349285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:11.349587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:11.349875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:11.350921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:11.351531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:11.353950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:11.371927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 618/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:11.378725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:11.526777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19509b6-6089-44fd-9995-d13c03adeaf6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:11.560045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:11.571440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:11.572021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:11.572310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:11.572631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:11.588495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:11.590307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:53:11.607159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:11.608575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:11.614595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 635/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:11.615277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:11.693008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:11.754670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119597f2-9a5c-459a-a4ab-9fd465d4aa96 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:11.804077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:11.804931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:11.805104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:11.805333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:11.806103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:11.806472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:11.808166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:11.836584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 619/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:53:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:11.843307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:11.984086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b2d59-4f47-442d-9eb5-044bf0ee51e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:12.028647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:12.029338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:12.029757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:12.031510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:12.120109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:12.137325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:12.138993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:12.288186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 636/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:53:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:53:12.289750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:12.443788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f6d3-939d-457a-a618-150f05fa99c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:12.460595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:12.489349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:12.489982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:12.490268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:12.490535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:12.505207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:12.507140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:12.527324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:12.529495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:12.531889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:12.531889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:12.531889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:12.531889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 620/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:12.538149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:12.672365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:12.685589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3ff65-82fe-4241-84b1-fb48877af385 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:12.729629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:12.730439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:12.730830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:12.731226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:12.732126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:12.732507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:12.734357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:12.749808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 637/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:12.757555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:12.888053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247584b-5d4a-42e2-a610-7555f97947f7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:12.932773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:12.933332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:12.933613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:12.933880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:12.943198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:12.944948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:53:12.958135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:12.959230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:12.960145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 621/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:12.968581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:13.103050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4483-c767-4474-86d5-a73190f2b51e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:13.154330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:13.154969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:13.154969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:13.155375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:13.156270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:13.156639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:13.158227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198401b8-a9c0-427e-a4e6-c709b3b632b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:13.172291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 638/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:13.187473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:13.214459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:13.308905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e777-2aeb-4cc3-a656-d552753e1ff3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:13.364125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:13.365018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:13.365260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:13.365826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:13.366937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:13.367401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:13.369539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8737805-4932-4066-8ccb-2a1b618f09aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:13.383596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 622/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:53:13 2022] GET /identity/v3/role_assignments?user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:15.597502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa499fa-97ba-4bef-b68a-c609d9526a3d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:15.598337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa499fa-97ba-4bef-b68a-c609d9526a3d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:15.598337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa499fa-97ba-4bef-b68a-c609d9526a3d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:15.599386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 639/1261] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:15.604920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:15.605371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:15.605470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:15.624991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:15.626218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:15.703281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 623/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 16:53:15.727152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa499fa-97ba-4bef-b68a-c609d9526a3d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:15.738817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:15.838207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa499fa-97ba-4bef-b68a-c609d9526a3d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:15.880606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:15.881184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:15.881462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:15.881729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:15.894411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:53:15.899824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:15.901286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:15.902150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 640/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:15.907087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:15.927297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:16.018841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628041f7-5fdd-4e96-aa58-067859519871 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.056155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.056790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.057066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.057336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.058008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:16.058312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:16.059789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:16.069829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 624/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:53:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:16.078790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:16.153513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:16.195223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550e90-53a6-4740-93a6-f3db74a7eb16 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.239801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.240516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.240795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.241098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.253691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:16.255150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:16.269343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:16.270542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:16.271771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:16.271771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:16.271771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:16.271771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 641/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:16.276775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:16.392939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:16.414336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880052-64c1-416f-bfb1-358a135db0d0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.450415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.451154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.451154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.451649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.452672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:16.452998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:16.454362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:16.468372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 625/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:16.474399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:16.580384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897edf7-d2f0-4b15-a7e9-fc865bc0ed30 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.602164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:16.617347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.617970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.618249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.618519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.626699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:16.628310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:53:16.640202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:16.641372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:16.642348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 642/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:16.647399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:16.758752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1a58-6d8e-4db7-a3dc-a6dbb786bc70 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.804095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.804807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.805101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.805374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.806192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:16.806562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:16.808255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:16.817669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:16.828375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 626/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:53:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:16.834652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:16.941196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c914-a6c5-4e51-83b7-d21444f4f9dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:16.987283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:16.987908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:16.988193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:16.988466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:16.999857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:17.001441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:17.016441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:17.017834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:17.019019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:17.019019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:17.019019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:17.019019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 643/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:17.023785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:17.135269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3e9f0-83f4-4e89-9fcf-294b868cde93 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:17.171218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:17.171809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:17.172085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:17.172356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:17.173020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:17.173322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:17.174677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:17.185619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 627/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:17.192123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:17.225108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:17.296691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b8e5a6-0647-45be-b536-f6d18f443a3c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:17.342310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:17.343088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:17.343365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:17.343637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:17.350964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:17.352394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:53:17.363386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:17.364515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:17.365646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 644/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:17.370498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:17.432967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:17.482098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ad80a-635b-447a-b61b-f783c9c5a77a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:17.516266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:17.516891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:17.517175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:17.517446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:17.518133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:17.518437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:17.519850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c87498-c8c6-425c-9621-2afd4a2571d4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:17.531976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 628/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:17.538366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:17.635213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:17.646413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404dbc4-320f-43c3-85b9-acbefc43028e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:17.698482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:17.699139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:17.699417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:17.699689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] PATH_INFO: `/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fa5c3ba51f2c4d5583dbd3ebbafed5ff/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:17.701947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] RBAC: Authorizing `identity:create_grant(project_id=a83921ca1624455aab3f5f5cbb59aca2, user_id=fa5c3ba51f2c4d5583dbd3ebbafed5ff, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:17.703659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7422-3e7c-461e-8cac-5c88f925c7ae None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:17.717951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 645/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 10 16:53:17 2022] PUT /identity/v3/projects/a83921ca1624455aab3f5f5cbb59aca2/users/fa5c3ba51f2c4d5583dbd3ebbafed5ff/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:53:19.812621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a4fe-6966-4134-877d-5b6e35d5476b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:19.813155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a4fe-6966-4134-877d-5b6e35d5476b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:19.813155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4a4fe-6966-4134-877d-5b6e35d5476b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:19.814520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 629/1274] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:19.820187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:19.820697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:19.820789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:19.839902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:19.841170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:19.914834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 646/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:19.939041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a4fe-6966-4134-877d-5b6e35d5476b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.040121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4a4fe-6966-4134-877d-5b6e35d5476b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.057855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:20.074423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.075302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.075573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.075836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.085651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 16:53:20.090191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:20.091321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:20.092994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 630/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 10 16:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:20.098426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.179087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:20.197976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb040-fb1a-44e9-a262-3dc984c522a3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.232176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.233430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.233909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.234300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.235037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:20.235335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:20.236753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:20.244865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 647/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:20.250871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.369585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb593-73f3-4782-be0e-44772e78f005 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.408122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.408769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.409045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.409316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.419152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:20.421246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:20.435178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:20.436168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:20.437239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:20.437239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:20.437239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:20.437239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 631/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:20.442442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.542449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f1fe-df5d-4583-ba7c-c04995983f34 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.575765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.576248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.577178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.577450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.578090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:20.578393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:20.579759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:20.591218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 648/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:20.597562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.628042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:20.698464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021657c-76f8-4f90-bbef-ca5f6a2569b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.733987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.734788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.735206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.735340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.743056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:20.744521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 16:53:20.755712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:20.757151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:20.758596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 632/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 16:53:20.766758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:20.770539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:20.866907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b1b2-5653-4a77-8c2f-f1d54d824cf4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:20.901158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:20.901775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:20.902055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:20.902325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:20.903057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:20.903360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:20.904860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:20.922743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 649/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:20.928627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:21.020470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:21.030424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8d19a-7626-492c-a9bf-6faa72df446a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:21.065731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:21.066338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:21.066619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:21.066899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:21.134081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:21.135529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:21.227974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:21.239523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 633/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 10 16:53:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 16:53:21.245338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:21.309691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:21.353659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258094a0-b1cd-48b8-9a6b-406b026f2706 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:21.388331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:21.389135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:21.389305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:21.389519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:21.399651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:21.401148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 16:53:21.415927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:21.417134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 16:53:21.418384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 16:53:21.418384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 16:53:21.418384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:21.418384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 650/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:21.424049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:21.524517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98fa3-b53c-4a38-9505-2663309a7f9e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:21.561169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:21.561771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:21.562047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:21.562315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:21.562967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:21.563268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:21.564687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:21.577883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 634/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 10 16:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:21.583647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:21.684585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781a40e-54bf-4f89-aee4-a685c9d16b64 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:21.700555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:21.721655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:21.722276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:21.722551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:21.722823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:21.729349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:21.730785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 16:53:21.742387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:21.743516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Aug 10 16:53:21.744657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 651/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 10 16:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:21.749633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:21.800165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:21.850660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419f61-6dde-4bb7-ae6c-b91eff70311a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:21.884687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:21.885292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:21.885572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:21.885842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:21.886529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:21.886833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:21.888247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec34f61-ce93-474c-9b34-635556d4c71f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:21.900415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 635/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 10 16:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 16:53:21.907312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:22.007083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c50747-39e1-4d38-a82c-460498c1d555 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:22.041362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:22.041957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:22.042232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:22.042496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:22.043210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] RBAC: Adding query filter params (role.id=d9d7215675154ba89ce19eaa12ac8f1e, scope.project.id=a83921ca1624455aab3f5f5cbb59aca2, user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:22.043511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:22.045030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3a38e-b99f-4ca6-8c9b-24b63a03624d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:22.051401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 652/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 10 16:53:21 2022] GET /identity/v3/role_assignments?user.id=fa5c3ba51f2c4d5583dbd3ebbafed5ff&scope.project.id=a83921ca1624455aab3f5f5cbb59aca2&role.id=d9d7215675154ba89ce19eaa12ac8f1e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:24.106527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d268-b69d-4e3c-befd-c420139a0129 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:24.107033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d268-b69d-4e3c-befd-c420139a0129 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:24.107033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71d268-b69d-4e3c-befd-c420139a0129 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:24.108943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 636/1288] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:24.114270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:24.114729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:24.114835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:24.142073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:24.143308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:24.175734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:24.215429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 653/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:24.238948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71d268-b69d-4e3c-befd-c420139a0129 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:24.355714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71d268-b69d-4e3c-befd-c420139a0129 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:24.372328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:24.407078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:24.407715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:24.407991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:24.408260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:24.408885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:24.410239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:24.419127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:24.420370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:24.421293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 637/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:53:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:24.426465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:24.563049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90728-4383-4513-90c5-d80a40d75de7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:24.597272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:24.597879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:24.598163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:24.598434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:24.599062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:24.599366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:24.600775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4359-b728-4b1c-a90a-dd2d17dec601 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:24.605489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 654/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 10 16:53:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:24.611792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:24.712660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fe8b4-10b4-48bb-91e3-1d3d44f0695c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:24.746641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:24.747239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:24.747521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:24.747794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:24.748955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:24.749262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:24.750614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40c8c6-d137-4bd8-8fd0-2da4a3ab8ff2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:24.755011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 638/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 10 16:53:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:26.765586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134847e-0ba9-49bb-8445-cf58685b51bb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:26.766119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134847e-0ba9-49bb-8445-cf58685b51bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:26.766119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134847e-0ba9-49bb-8445-cf58685b51bb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:26.767453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 655/1293] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:26.773025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f510-c3fe-4aad-8f57-26ef6abf3290 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:26.773461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f510-c3fe-4aad-8f57-26ef6abf3290 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:26.773570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44f510-c3fe-4aad-8f57-26ef6abf3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:26.791974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e44f510-c3fe-4aad-8f57-26ef6abf3290 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:26.793201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e44f510-c3fe-4aad-8f57-26ef6abf3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:26.823889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:26.863903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 639/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:26.885827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134847e-0ba9-49bb-8445-cf58685b51bb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:26.918051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:26.990486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134847e-0ba9-49bb-8445-cf58685b51bb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:27.024597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:27.025196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:27.025471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:27.025737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:27.026366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:27.027841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9357d68-0170-458c-9953-b8b48ac1319e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:27.043096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 656/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 10 16:53:26 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:53:29.100700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa52cc-56ca-4b1a-9b5b-29054e9bda61 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.101439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa52cc-56ca-4b1a-9b5b-29054e9bda61 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.101439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa52cc-56ca-4b1a-9b5b-29054e9bda61 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.102387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 640/1296] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:29.108415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.109059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.109059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.127550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:29.128768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:29.200401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 657/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:29.223423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa52cc-56ca-4b1a-9b5b-29054e9bda61 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:29.329456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa52cc-56ca-4b1a-9b5b-29054e9bda61 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:29.371576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:29.372459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.372937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.373262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.374218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:29.376053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:29.386288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:29.387456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:29.389087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 641/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:53:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:29.394050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:29.416114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:29.500230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3407a-42ed-4999-be76-aff1b2eb186b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:29.535106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:29.535712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.535989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.536257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.536903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:29.537202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:29.538560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:29.543678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 658/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 10 16:53:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:29.549840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:29.585397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:29.660793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ddbcf-9a39-4b04-9b69-4500721871d2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:29.700564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:29.701979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.702460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.702840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.703745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] RBAC: Adding query filter params (interface=public, service_id=76941f8dbc9941709608738e0837fd06, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:29.704071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:29.705960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c04de6c-62e5-4c29-9d83-5f3c98c461f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:29.712116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 642/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 10 16:53:29 2022] GET /identity/v3/endpoints?service_id=76941f8dbc9941709608738e0837fd06&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:29.718311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:29.800560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:29.821297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3710-9bbb-4784-9599-7441462e15b7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:29.855831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:29.856557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:29.856835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:29.857101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:29.858350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:29.859234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d2343-d84e-4ec7-8da2-0557df69a81e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:29.865973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 659/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 10 16:53:29 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 16:53:31.876718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08182-6c14-4c13-b17d-fd01ab6dfd26 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:31.877279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08182-6c14-4c13-b17d-fd01ab6dfd26 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:31.877279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a08182-6c14-4c13-b17d-fd01ab6dfd26 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:31.878758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 643/1302] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:53:31.883807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:31.884228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:31.884342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:31.902466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:53:31.903630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:53:31.971262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 660/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:53:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 16:53:31.995047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08182-6c14-4c13-b17d-fd01ab6dfd26 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:32.089257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:32.097244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a08182-6c14-4c13-b17d-fd01ab6dfd26 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:32.131534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:32.132152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:32.132429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:32.132729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:32.133314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:32.134670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 16:53:32.143564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 16:53:32.144818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Aug 10 16:53:32.145910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 644/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 10 16:53:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 16:53:32.150849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:32.228286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:32.252771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fd352-9ad3-4cc7-a464-375550beacc0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:32.287412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:32.288018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:32.288289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:32.288583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:32.289210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:53:32.289511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:32.290864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4c984-1f7c-429f-a063-4bf1ffdfe19f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:32.296723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 661/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 10 16:53:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:53:32.302598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:53:32.414155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d2ae0-20ce-427a-b7b6-8aa0b1b71eef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:53:32.452214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:53:32.452842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:53:32.453123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:53:32.453572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:53:32.454248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:53:32.455620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb7a0a-05fe-4191-816e-9364cf0d50f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:53:32.479406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 645/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:53:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 16:53:42.293004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=30 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:53:42.475438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:38.420362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a281c7d-8c58-44a0-ba67-391d41f3d86a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:38.421002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a281c7d-8c58-44a0-ba67-391d41f3d86a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:38.421002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a281c7d-8c58-44a0-ba67-391d41f3d86a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:38.426873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 662/1307] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:38.428270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e0f2-ae67-49a2-a07b-fcf6a91c865f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:38.428793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e0f2-ae67-49a2-a07b-fcf6a91c865f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:38.428891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e0f2-ae67-49a2-a07b-fcf6a91c865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:38.545485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5667e0f2-ae67-49a2-a07b-fcf6a91c865f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:38.546808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5667e0f2-ae67-49a2-a07b-fcf6a91c865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:38.693108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 646/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:54:38.739816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:38.740143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:38.740374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:38.741805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 663/1309] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 10 16:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:38.752837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56048-cd99-4e8a-9672-d8359dbc6ed8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:38.753189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56048-cd99-4e8a-9672-d8359dbc6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:38.753395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56048-cd99-4e8a-9672-d8359dbc6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:38.861830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-18a56048-cd99-4e8a-9672-d8359dbc6ed8 None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:38.863090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-18a56048-cd99-4e8a-9672-d8359dbc6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:38.891453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:38.968763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 647/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 10 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:38.978636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:38.981364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:39.127503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eb0ae-13dd-4d3d-ae0c-c11399d3974e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:39.216847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:39.217473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:39.217752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:39.218034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:39.219727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:39.285836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:39.362766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:39.364157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6395468-5987-4a07-a04b-d09a85dcde83 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:39.389936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 664/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:41.802003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:41.802613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:41.802613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:41.804825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 648/1312] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:41.810403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ff4c-c8af-4e8a-973e-d3fbe0c3c626 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:41.810985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ff4c-c8af-4e8a-973e-d3fbe0c3c626 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:41.810985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ff4c-c8af-4e8a-973e-d3fbe0c3c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:41.897884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8998ff4c-c8af-4e8a-973e-d3fbe0c3c626 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:41.899126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8998ff4c-c8af-4e8a-973e-d3fbe0c3c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:42.014518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 665/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:42.054907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:42.056645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:42.170028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade6d04-c1eb-4de6-80d8-55fe335e44a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:42.249658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:42.252415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:42.253451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:42.253893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:42.254364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:42.256000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:42.368285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:42.369595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8589d-e236-463f-8152-6f3c3ff6217b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:42.390381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 649/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:44.743451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:44.743990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:44.743990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:44.746206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 666/1315] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:44.751237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184e8e-26c6-4eac-abf7-e627fe959487 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:44.751665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184e8e-26c6-4eac-abf7-e627fe959487 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:44.751774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e184e8e-26c6-4eac-abf7-e627fe959487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:44.817467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e184e8e-26c6-4eac-abf7-e627fe959487 None None] MFA Rules not processed for user `f5a53e96d82348b78ee94b66e1baa542`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:44.818698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e184e8e-26c6-4eac-abf7-e627fe959487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:44.869821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:44.914770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 650/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:44.957681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:44.959217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:44.969689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:45.061854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dae073-5ad6-451b-875c-296a7acf8e62 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:45.133133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:45.133774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:45.134074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:45.134344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:45.135951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:45.197049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:45.246067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:45.247429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41078-58cd-47ce-a4c7-215e8d1ff4f8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:45.265767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 667/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:47.889748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b5d8-35c3-490b-93ef-afb184f57834 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:47.890192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b5d8-35c3-490b-93ef-afb184f57834 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:47.890295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57b5d8-35c3-490b-93ef-afb184f57834 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:47.891632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 651/1318] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:47.896984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b93d9-7ac8-406d-b482-b83df1f4214f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:47.897412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b93d9-7ac8-406d-b482-b83df1f4214f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:47.897533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b93d9-7ac8-406d-b482-b83df1f4214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:47.962197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a83b93d9-7ac8-406d-b482-b83df1f4214f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:47.963366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a83b93d9-7ac8-406d-b482-b83df1f4214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:48.058310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 668/1319] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:54:48.109742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a428d-4345-446b-9f72-292e786882b1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:48.110028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a428d-4345-446b-9f72-292e786882b1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:48.110302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a428d-4345-446b-9f72-292e786882b1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:48.111658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 652/1320] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 10 16:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:48.117222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ff44-7f3c-4fd6-8ed8-95ccfbe75e3f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:48.117579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ff44-7f3c-4fd6-8ed8-95ccfbe75e3f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:48.117863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ff44-7f3c-4fd6-8ed8-95ccfbe75e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:48.140679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:48.194509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8af3ff44-7f3c-4fd6-8ed8-95ccfbe75e3f None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:48.195716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8af3ff44-7f3c-4fd6-8ed8-95ccfbe75e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:48.270019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 669/1321] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 10 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:48.278917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a428d-4345-446b-9f72-292e786882b1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:48.280472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-166a428d-4345-446b-9f72-292e786882b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:48.384944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a428d-4345-446b-9f72-292e786882b1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:48.456210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:48.456828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:48.457104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:48.457370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:48.458944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:48.466291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:48.568355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:48.569741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4c5a-2d16-4718-9616-39d3d6b947c1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:48.589881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 653/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:51.747580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:51.748112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:51.748112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:51.749604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 670/1323] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:51.755484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513412-14ea-4e6c-89c6-a7b40350b804 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:51.755938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513412-14ea-4e6c-89c6-a7b40350b804 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:51.756031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88513412-14ea-4e6c-89c6-a7b40350b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:51.826050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-88513412-14ea-4e6c-89c6-a7b40350b804 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:51.827244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-88513412-14ea-4e6c-89c6-a7b40350b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:51.893449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:51.940213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 654/1324] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:51.976780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:51.978325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:52.089425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff887b-7e06-44cd-8eb7-bcdfeaee8780 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:52.102675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:52.165743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:52.166860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:52.167140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:52.167609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:52.169252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:52.281155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:52.282526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5099d5-2ae6-467f-a2c6-cab6bcd10ea7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:52.301010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 671/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:54.461759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:54.462265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:54.462265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:54.464662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 655/1326] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:54.470082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290259-5d0b-43a8-b8f7-f407dfdb97c8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:54.470578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290259-5d0b-43a8-b8f7-f407dfdb97c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:54.470675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02290259-5d0b-43a8-b8f7-f407dfdb97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:54.521982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:54.541826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-02290259-5d0b-43a8-b8f7-f407dfdb97c8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:54.543263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-02290259-5d0b-43a8-b8f7-f407dfdb97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:54.640557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 672/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:54.677105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:54.678636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:54.787624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54586b-aad8-4f06-af80-495143e3f84d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:54.866694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:54.867306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:54.867685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:54.867954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:54.870445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:54.888387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:54.984384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:54.985845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472847a1-2eeb-431b-b96b-d0b71a03239f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:55.004824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 656/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:57.093925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:57.094446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:57.094446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:57.095726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 673/1329] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:57.101030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561506-86c5-4eb7-8a9a-dd9a73cce179 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:57.101474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561506-86c5-4eb7-8a9a-dd9a73cce179 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:57.101595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19561506-86c5-4eb7-8a9a-dd9a73cce179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:57.170800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-19561506-86c5-4eb7-8a9a-dd9a73cce179 None None] MFA Rules not processed for user `f5a53e96d82348b78ee94b66e1baa542`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:54:57.172009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19561506-86c5-4eb7-8a9a-dd9a73cce179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:57.240474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:57.277297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 657/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:54:57.316433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:54:57.318026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:57.421849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc5152-cdac-4ecc-8f9b-1df8971e821c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:54:57.442315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:54:57.498257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:54:57.499116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:57.499399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:57.499678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:57.501374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:54:57.614349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:54:57.615800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158e763-f426-4154-9dee-c537d4c3915e service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:54:57.634126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 674/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:54:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:54:59.987160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:59.987688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:59.987688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:54:59.989178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 658/1332] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:54:59.994919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00153-8965-4adf-9b18-814880db1970 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:54:59.995415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00153-8965-4adf-9b18-814880db1970 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:54:59.995513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00153-8965-4adf-9b18-814880db1970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:00.059311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:00.062192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a8a00153-8965-4adf-9b18-814880db1970 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:00.063970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a8a00153-8965-4adf-9b18-814880db1970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:00.162337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 675/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:00.200222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:00.201800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:00.303184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f0be-8e6b-42b4-9120-f8b6cb095bb7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:00.377078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:00.377681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:00.377960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:00.378231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:00.379855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:00.406207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:00.489963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:00.491304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95995c-bf76-409e-aac5-d2bc710ae135 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:00.509110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 659/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:02.612604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:02.613137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:02.613137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:02.614510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 676/1335] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:02.620351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edc05c-0c57-4b79-9f8b-e9dcaf6671d6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:02.620913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edc05c-0c57-4b79-9f8b-e9dcaf6671d6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:02.620913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edc05c-0c57-4b79-9f8b-e9dcaf6671d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:02.687263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-16edc05c-0c57-4b79-9f8b-e9dcaf6671d6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:02.688493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-16edc05c-0c57-4b79-9f8b-e9dcaf6671d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:02.764326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:02.788337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 660/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:02.829141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:02.830659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:02.936791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70fe04-9288-4f69-adec-2c1ebcdb5dd0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:02.966466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:03.011206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:03.011815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:03.012092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:03.012363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:03.013989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:03.123385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:03.124871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ddbef-86cc-417f-98ec-63a4ce0ef7d0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:03.143319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 677/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:05.618166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:05.618795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:05.618795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:05.620173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 661/1338] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:05.625618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75793-a064-444e-8976-011a35547c2e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:05.626064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75793-a064-444e-8976-011a35547c2e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:05.626160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75793-a064-444e-8976-011a35547c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:05.692339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e8f75793-a064-444e-8976-011a35547c2e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:05.693599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e8f75793-a064-444e-8976-011a35547c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:05.702561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:05.790009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 678/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:05.826996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:05.828604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:05.930914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f607ff4-b06d-4166-8d55-7d96a2c79954 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:06.003607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:06.004201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:06.004504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:06.004783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:06.006366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:06.042467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:06.115446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:06.116915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdd1e-e995-4972-bd00-2bbe09f395cc service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:06.135611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 662/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:10.338320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:10.338877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:10.338984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:10.340396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 679/1341] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:10.345969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6198-8458-4447-9a9d-e550e703677b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:10.346402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6198-8458-4447-9a9d-e550e703677b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:10.346609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6198-8458-4447-9a9d-e550e703677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:10.418573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-189e6198-8458-4447-9a9d-e550e703677b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:10.419763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-189e6198-8458-4447-9a9d-e550e703677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:10.508828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:10.522104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 663/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:10.561654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:10.563211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:10.670288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ae566-905e-45b5-b636-e66519ef4aa3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:10.709539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:10.746568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:10.747179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:10.747458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:10.747726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:10.749352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:10.860656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:10.862178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76ce91-3f79-400c-a550-593b237e8912 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:10.880348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 680/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:13.547730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:13.548356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:13.548586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:13.550108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 664/1344] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:13.556756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471da-cbfc-4885-a967-2575ee84ed8d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:13.556756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471da-cbfc-4885-a967-2575ee84ed8d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:13.556756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639471da-cbfc-4885-a967-2575ee84ed8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:13.635669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-639471da-cbfc-4885-a967-2575ee84ed8d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:13.636939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-639471da-cbfc-4885-a967-2575ee84ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:13.656076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:13.738656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 681/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:13.776821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:13.778365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:13.888071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50260220-ab17-4550-919e-3c26aefa0c84 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:13.963720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:13.964664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:13.964948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:13.965226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:13.967218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:14.011388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:14.080133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:14.081597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb69d5-6246-48e4-a366-a68b6f98ec2c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:14.100288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 665/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:18.168973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:18.169536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:18.169536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:18.170886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 682/1347] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:18.176102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd6bf2-08bf-4e5b-ae90-c94c9350ca64 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:18.176542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd6bf2-08bf-4e5b-ae90-c94c9350ca64 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:18.176698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd6bf2-08bf-4e5b-ae90-c94c9350ca64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:18.247797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2bdd6bf2-08bf-4e5b-ae90-c94c9350ca64 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:18.248961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2bdd6bf2-08bf-4e5b-ae90-c94c9350ca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:18.355303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:18.358256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 666/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:18.402190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:18.403720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:18.522101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a446f-0bef-4c77-ad23-8824db287be2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:18.573850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:18.603858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:18.604497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:18.604792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:18.605064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:18.606695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:18.724107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:18.725639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e30b0-6922-490b-8363-7e9412d9e1b2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:18.746135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 683/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:23.985092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03427b-bb09-44e9-8e67-7cd3f6d5fc3d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:23.990600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03427b-bb09-44e9-8e67-7cd3f6d5fc3d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:23.991261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03427b-bb09-44e9-8e67-7cd3f6d5fc3d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:23.993542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 667/1350] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 16:55:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:24.013876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44cfd-3c03-43c1-b983-06e7633d9016 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:24.014368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44cfd-3c03-43c1-b983-06e7633d9016 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:24.014644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced44cfd-3c03-43c1-b983-06e7633d9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:24.128511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ced44cfd-3c03-43c1-b983-06e7633d9016 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:24.129811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ced44cfd-3c03-43c1-b983-06e7633d9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:24.152241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:24.263174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 684/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 16:55:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:28.395585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28fb2-425e-45a4-8ce2-4a83920d90fa None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:28.396588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28fb2-425e-45a4-8ce2-4a83920d90fa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:28.397029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e28fb2-425e-45a4-8ce2-4a83920d90fa None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:28.399138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 668/1352] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 16:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:28.406703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c52f-d89d-4bd0-92ee-69de26f6b9d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:28.407228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c52f-d89d-4bd0-92ee-69de26f6b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:28.407309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0c52f-d89d-4bd0-92ee-69de26f6b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:28.499672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e8b0c52f-d89d-4bd0-92ee-69de26f6b9d2 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:28.500939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e8b0c52f-d89d-4bd0-92ee-69de26f6b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:28.587727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:28.634026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 685/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 16:55:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:30.235301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e798-a5db-43d4-a2b7-a7692bbe4b87 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:30.235891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e798-a5db-43d4-a2b7-a7692bbe4b87 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:30.235891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63e798-a5db-43d4-a2b7-a7692bbe4b87 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:30.237258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 669/1354] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 16:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:30.244890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922590-919a-4f28-8865-08fb09303006 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:30.245423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922590-919a-4f28-8865-08fb09303006 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:30.245423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922590-919a-4f28-8865-08fb09303006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:30.351859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9f922590-919a-4f28-8865-08fb09303006 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:30.353262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9f922590-919a-4f28-8865-08fb09303006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:30.476158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 686/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:34.056153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b34-6a81-486d-920f-67bed294fe9f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:34.056838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b34-6a81-486d-920f-67bed294fe9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:34.056838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03b34-6a81-486d-920f-67bed294fe9f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:34.058090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 670/1356] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:34.063405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8091be-8892-450c-a611-741c16202776 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:34.063834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8091be-8892-450c-a611-741c16202776 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:34.063954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8091be-8892-450c-a611-741c16202776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:34.100053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:34.140845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f8091be-8892-450c-a611-741c16202776 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:34.140845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f8091be-8892-450c-a611-741c16202776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:34.304750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 687/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:34.365152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:34.365653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:34.366711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:34.369058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 671/1358] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 10 16:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:34.377621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db6c8-6899-4db2-ae38-582fe943d2bd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:34.378155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db6c8-6899-4db2-ae38-582fe943d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:34.378741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db6c8-6899-4db2-ae38-582fe943d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:34.473909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-911db6c8-6899-4db2-ae38-582fe943d2bd None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:34.475279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-911db6c8-6899-4db2-ae38-582fe943d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:34.528879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:34.609459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 688/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 10 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:34.617313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:34.619442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:34.785534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b2089-7f6f-4175-9b35-3bcc0a05ea09 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:34.862429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:34.908178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:34.909211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:34.909684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:34.910139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:34.913021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:35.005987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:35.007654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cd24a-963f-4f00-a353-4c02e910affc service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:35.027942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 672/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:37.295333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:37.295851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:37.295851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:37.297382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 689/1361] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:37.302639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6f8a-6d32-4450-9cc8-b729618c2249 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:37.303046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6f8a-6d32-4450-9cc8-b729618c2249 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:37.303285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6f8a-6d32-4450-9cc8-b729618c2249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:37.376834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5ff6f8a-6d32-4450-9cc8-b729618c2249 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:37.378880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5ff6f8a-6d32-4450-9cc8-b729618c2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:37.429128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:37.503115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 673/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:37.550084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:37.551868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:37.738058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb6b4-9681-4327-b7f0-14ad37efd65b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:37.749123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:37.877996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:37.878634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:37.878912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:37.879180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:37.880961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:37.997843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:37.999451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef630895-a689-4275-9a95-288b07b97b9a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:38.019100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 690/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:40.404354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6649b8-073b-4a3d-a2b4-2ba49d92a0fd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:40.405226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6649b8-073b-4a3d-a2b4-2ba49d92a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:40.405504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6649b8-073b-4a3d-a2b4-2ba49d92a0fd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:40.407052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 674/1364] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:40.414605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909158c-e2b9-47ef-b6c0-7fb962e0c285 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:40.415087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909158c-e2b9-47ef-b6c0-7fb962e0c285 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:40.415087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909158c-e2b9-47ef-b6c0-7fb962e0c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:40.439630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:40.506250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6909158c-e2b9-47ef-b6c0-7fb962e0c285 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:40.507463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6909158c-e2b9-47ef-b6c0-7fb962e0c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:40.628822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 691/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:40.673668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:40.674063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:40.674244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:40.675848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 675/1366] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 10 16:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:40.682029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285220b-a16d-4f2f-a045-f83aa0825fe8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:40.682342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285220b-a16d-4f2f-a045-f83aa0825fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:40.682576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285220b-a16d-4f2f-a045-f83aa0825fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:40.775344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b285220b-a16d-4f2f-a045-f83aa0825fe8 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:40.776834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b285220b-a16d-4f2f-a045-f83aa0825fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:40.816250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:40.916403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 692/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 10 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:40.924022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:40.925718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:41.085943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dbc46-5a76-442a-8d0b-4df333d99521 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:41.108458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:41.211632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:41.212351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:41.212676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:41.212947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:41.214599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:41.313031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:41.314645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f68bf-f9bd-4c89-b690-15e2f9923e39 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:41.336665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 676/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:42.559018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56216140-0031-4d44-b05c-91b81c37acb2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:42.559691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56216140-0031-4d44-b05c-91b81c37acb2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:42.559691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56216140-0031-4d44-b05c-91b81c37acb2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:42.561087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 693/1369] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:42.566146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fa199-ea70-4c8e-9ef5-90797dfe9efd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:42.566594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fa199-ea70-4c8e-9ef5-90797dfe9efd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:42.566786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fa199-ea70-4c8e-9ef5-90797dfe9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:42.602639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:42.640601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-638fa199-ea70-4c8e-9ef5-90797dfe9efd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:42.641812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-638fa199-ea70-4c8e-9ef5-90797dfe9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:42.751571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 677/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:43.109673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.109673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.109673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.112396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 694/1371] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 10 16:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:43.115069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086e36-fb8c-48ac-bb50-9a12e3f5a4af None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.115352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086e36-fb8c-48ac-bb50-9a12e3f5a4af None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.115625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b086e36-fb8c-48ac-bb50-9a12e3f5a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.197981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5b086e36-fb8c-48ac-bb50-9a12e3f5a4af None None] MFA Rules not processed for user `fb66e8f0439d48fd9805921211801b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:43.199429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b086e36-fb8c-48ac-bb50-9a12e3f5a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:43.248984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:43.280974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 678/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 10 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:43.289011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:43.290673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:43.403644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cac971-3d8a-4472-acfb-35b986372b07 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:43.451167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:43.464245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c641a4-1450-436f-8c31-1f73199702e5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.464623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c641a4-1450-436f-8c31-1f73199702e5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.464810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c641a4-1450-436f-8c31-1f73199702e5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.466474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 679/1373] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:55:43.471259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade341f8-de41-4004-9ed0-6b59b0a30d79 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.471547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade341f8-de41-4004-9ed0-6b59b0a30d79 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.471875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade341f8-de41-4004-9ed0-6b59b0a30d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.493710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:43.494325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.494601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.494869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.496986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:43.552173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ade341f8-de41-4004-9ed0-6b59b0a30d79 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:43.553927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ade341f8-de41-4004-9ed0-6b59b0a30d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:43.616276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:43.617800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:43.643068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 695/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:43.672522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 680/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:43.719939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:43.721155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:43.801869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:43.839373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9a50-075d-49f9-a865-8b035bfebaae service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:43.964713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:43.965212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:43.965517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:43.965674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:43.967725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:44.058374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:44.074351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:44.076265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a6c14-6126-4b80-998b-b2d36299008a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:44.096589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 696/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:46.176998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:46.177549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:46.177549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:46.178889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 681/1377] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:46.184338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fafd40-f7e8-4147-a435-fe4892848d53 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:46.184884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fafd40-f7e8-4147-a435-fe4892848d53 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:46.184991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fafd40-f7e8-4147-a435-fe4892848d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:46.254587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c0fafd40-f7e8-4147-a435-fe4892848d53 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:46.255821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c0fafd40-f7e8-4147-a435-fe4892848d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:46.382376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 697/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:46.427085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:46.428560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:46.481679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:46.591372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391dfb50-72cd-4fc7-aae3-e52b324c325f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:46.718176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:46.718790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:46.719075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:46.719468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:46.721072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:46.733084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:46.841989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:46.843519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeda820-02ae-4a05-b278-ca96699e62d4 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:46.861695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 682/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:48.986669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:48.987141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:48.987225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:48.988729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 698/1380] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:48.993908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af98-dbf4-4eec-941f-2e36c9463e26 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:48.994391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af98-dbf4-4eec-941f-2e36c9463e26 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:48.994891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21af98-dbf4-4eec-941f-2e36c9463e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:49.066227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb21af98-dbf4-4eec-941f-2e36c9463e26 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:49.067562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb21af98-dbf4-4eec-941f-2e36c9463e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:49.158518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:49.173222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 683/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:49.219261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:49.220765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:49.284991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:49.379319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f437fa9-f2be-4c1e-87d1-04c0626924db None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:49.513026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:49.513549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:49.513824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:49.514090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:49.515701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:49.538475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:49.611670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:49.613474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7097c821-18b0-4903-88fc-d2007eb56afe service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:49.636442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 699/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:51.783675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:51.784222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:51.784222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:51.785620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 684/1383] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:55:51.791543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf30dc-eea0-4b22-9580-f6585c0aba8b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:51.792302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf30dc-eea0-4b22-9580-f6585c0aba8b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:51.792302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf30dc-eea0-4b22-9580-f6585c0aba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:51.861498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e1cf30dc-eea0-4b22-9580-f6585c0aba8b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:51.862774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e1cf30dc-eea0-4b22-9580-f6585c0aba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:51.999417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:52.004621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 700/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:52.046689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:52.048273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:52.227281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bba732-c7c8-4f41-a9ce-57dee90243d7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:52.295452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:52.350405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:52.351200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:52.351580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:52.351994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:52.354040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:52.454596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:52.456216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a807360-084c-499d-841a-84669dd853f7 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:52.475220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 685/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:54.810636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:54.811189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:54.811321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:54.812770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 701/1386] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:54.818460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abc53-f06b-4d19-8da3-711d73c524e4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:54.818898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abc53-f06b-4d19-8da3-711d73c524e4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:54.819260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abc53-f06b-4d19-8da3-711d73c524e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:54.907202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-237abc53-f06b-4d19-8da3-711d73c524e4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:54.908810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-237abc53-f06b-4d19-8da3-711d73c524e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:54.941336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:55.028557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 686/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:55.073849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:55.075667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:55.236245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db0b3-ff72-4303-8c1b-afd165456a4e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:55.315769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:55.380189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:55.380865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:55.381158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:55.381445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:55.383935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:55.545048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:55.551763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc70703-baf8-461e-a258-7806de456f69 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:55.595777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 702/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:57.810507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:57.811165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:57.811165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:57.812511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 687/1389] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:57.818204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132163-3412-4787-9243-6bdc5e02473f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:57.818689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132163-3412-4787-9243-6bdc5e02473f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:57.818792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5132163-3412-4787-9243-6bdc5e02473f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:57.890660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c5132163-3412-4787-9243-6bdc5e02473f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:57.891884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c5132163-3412-4787-9243-6bdc5e02473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:57.930639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:58.002961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 703/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:55:58.049114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:58.050677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:58.207927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb429cc-00ff-40ea-8009-263bcf755a46 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:58.218319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:58.327441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:58.328157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:58.328468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:58.328851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:58.330561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:58.425484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:55:58.427087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5853e3-98eb-4095-8668-416b4e3833f9 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:55:58.447373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 688/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:55:59.296965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23762-7377-49ed-9266-dc2b48ebd29c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:59.297548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23762-7377-49ed-9266-dc2b48ebd29c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:59.297548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f23762-7377-49ed-9266-dc2b48ebd29c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:59.298885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 704/1392] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:59.304108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af1a8-b375-4d9c-bc47-2a271250ff2c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:59.304583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af1a8-b375-4d9c-bc47-2a271250ff2c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:59.304685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af1a8-b375-4d9c-bc47-2a271250ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:59.321592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:59.377398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2f0af1a8-b375-4d9c-bc47-2a271250ff2c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:59.378612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2f0af1a8-b375-4d9c-bc47-2a271250ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:59.481226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 689/1393] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:59.539486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:59.539781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:59.540036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:59.541453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 705/1394] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 10 16:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:55:59.546906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333066-3831-419e-af43-ae75bad638c7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:59.547245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333066-3831-419e-af43-ae75bad638c7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:59.547511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb333066-3831-419e-af43-ae75bad638c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:59.642384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb333066-3831-419e-af43-ae75bad638c7 None None] MFA Rules not processed for user `530609a984b24349a028bcf07ae290ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:55:59.643585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb333066-3831-419e-af43-ae75bad638c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:59.682880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:59.728645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 690/1395] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 10 16:55:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:55:59.736889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:55:59.738575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:55:59.852714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d5c4-c771-461f-9c3b-a3322a32da18 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:55:59.921171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:55:59.935572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:55:59.935572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:55:59.935572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:55:59.935572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:55:59.937431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:00.053020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:00.055134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25f7ef-d6ca-4280-8be0-82754e253c80 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:00.073706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 706/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:00.548462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:00.549001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:00.549112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:00.550392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 691/1397] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:00.555704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076aec3-aed8-491a-b030-f2dace85f57a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:00.556163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076aec3-aed8-491a-b030-f2dace85f57a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:00.556274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076aec3-aed8-491a-b030-f2dace85f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:00.630166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4076aec3-aed8-491a-b030-f2dace85f57a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:00.631401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4076aec3-aed8-491a-b030-f2dace85f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:00.677996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:00.744868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 707/1398] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:00.791304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:00.792868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:00.854259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d43fd-59b8-457c-80f3-ef967fe15108 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:00.854541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d43fd-59b8-457c-80f3-ef967fe15108 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:00.854824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d43fd-59b8-457c-80f3-ef967fe15108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:00.937698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-273d43fd-59b8-457c-80f3-ef967fe15108 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:00.938912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-273d43fd-59b8-457c-80f3-ef967fe15108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:00.956466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e91a4a-cc9f-4f23-b210-8e1284d43266 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:01.000208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:01.031398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 708/1399] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:01.081960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:01.082575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:01.082861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:01.082973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fab5-746c-46b1-8f1b-bca22516da6b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:01.083140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:01.083280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fab5-746c-46b1-8f1b-bca22516da6b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:01.083495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fab5-746c-46b1-8f1b-bca22516da6b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:01.084782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:01.084921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 709/1400] 10.222.0.39 () {54 vars in 943 bytes} [Wed Aug 10 16:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:56:01.091475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc03cf-7e85-4a85-97e2-383b53ce8630 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:01.091830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc03cf-7e85-4a85-97e2-383b53ce8630 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:01.092189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc03cf-7e85-4a85-97e2-383b53ce8630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:01.141388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:01.173917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-59bc03cf-7e85-4a85-97e2-383b53ce8630 None None] MFA Rules not processed for user `11327e8df21f49039aab8222a571f1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:01.175121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59bc03cf-7e85-4a85-97e2-383b53ce8630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:01.187130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:01.188927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:01.208884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 692/1401] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:01.300545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 710/1402] 10.222.0.39 () {58 vars in 1040 bytes} [Wed Aug 10 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:01.312207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:01.313511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:01.376335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:01.433321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd7e80-cfc6-4464-9f1b-4512b30a80d4 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:01.546932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:01.547460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:01.547743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:01.548016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:01.549690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:01.637895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:01.642788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:01.644619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728956a-9e3c-463a-97f2-1084693ee7ff service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:01.653504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 693/1403] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 16:56:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 16:56:03.362169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:03.362729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:03.362729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:03.364067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 711/1404] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:03.369826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7de7-1b21-4ede-8fd6-899c51da88c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:03.370260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7de7-1b21-4ede-8fd6-899c51da88c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:03.370436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7de7-1b21-4ede-8fd6-899c51da88c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:03.447480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d23b7de7-1b21-4ede-8fd6-899c51da88c9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:03.448797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d23b7de7-1b21-4ede-8fd6-899c51da88c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:03.566145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 694/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:03.614102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:03.615527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:03.732901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:03.803946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bef465-c373-4ede-b3e0-30b6fc0c2483 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:03.950293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:03.950958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:03.951242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:03.951540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:03.953321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:04.035696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:04.087090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:04.089212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7dd8-6db1-4193-af2f-ef8de25e7941 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:04.111408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 712/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:06.384830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:06.386078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:06.386589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:06.388220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 695/1407] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:06.394940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b79e6-821a-458a-813f-2a0beb1e2bea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:06.395380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b79e6-821a-458a-813f-2a0beb1e2bea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:06.395472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b79e6-821a-458a-813f-2a0beb1e2bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:06.482870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cb7b79e6-821a-458a-813f-2a0beb1e2bea None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:06.484250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cb7b79e6-821a-458a-813f-2a0beb1e2bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:06.623378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 713/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:06.669375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:06.670901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:06.806484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:06.904522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ddc3b-9d91-42c4-901e-a69857ac05dd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:07.203691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:07.204443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:07.204823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:07.205075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:07.213704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:07.262417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:07.345244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:07.346942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac475f9-aa02-48e6-82ef-a2c926feb36e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:07.367621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 696/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:16.621313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:17.364189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=30 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:24.205950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee936-5a62-4c95-8fd8-4de96ddcba8f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:24.206482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee936-5a62-4c95-8fd8-4de96ddcba8f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:24.206482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee936-5a62-4c95-8fd8-4de96ddcba8f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:24.207766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 714/1410] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 10 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:24.213295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8d4b-7c6d-4cec-9f22-4401f23e5de4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:24.213758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8d4b-7c6d-4cec-9f22-4401f23e5de4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:24.213861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff8d4b-7c6d-4cec-9f22-4401f23e5de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:24.291807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a4ff8d4b-7c6d-4cec-9f22-4401f23e5de4 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:24.293060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a4ff8d4b-7c6d-4cec-9f22-4401f23e5de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:24.401850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 697/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 10 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:24.417090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5255-5035-4fe4-b5e0-ffd3b4ef58a7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:24.417443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5255-5035-4fe4-b5e0-ffd3b4ef58a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:24.417717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d5255-5035-4fe4-b5e0-ffd3b4ef58a7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:24.419089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 715/1412] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 10 16:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:24.423916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c434d2-d4e1-49eb-815a-501063e7abf4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:24.424202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c434d2-d4e1-49eb-815a-501063e7abf4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:24.424473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c434d2-d4e1-49eb-815a-501063e7abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:24.500850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:24.504323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-58c434d2-d4e1-49eb-815a-501063e7abf4 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:24.505765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58c434d2-d4e1-49eb-815a-501063e7abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:24.621757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 698/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 10 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:27.101964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:27.102517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:27.102517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:27.103766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:27.109057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23975d-d248-4c6d-8636-3e7586cc98fc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:27.109459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23975d-d248-4c6d-8636-3e7586cc98fc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:27.109609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23975d-d248-4c6d-8636-3e7586cc98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:27.174495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c23975d-d248-4c6d-8636-3e7586cc98fc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:27.175696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c23975d-d248-4c6d-8636-3e7586cc98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:27.231006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:27.274709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:27.317274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:27.319488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:27.465512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facffdbb-70f1-4d89-ab12-50790eef82b3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:27.537023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:27.577505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:27.578117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:27.578419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:27.578696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:27.580291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:27.668866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:27.670505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e600b-dacf-4521-901c-3ee804130188 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:27.689134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 717/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:28.586408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:28.586988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:28.586988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:28.588326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:28.593483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814c57-0936-417b-98b9-24d7e62325f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:28.593924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814c57-0936-417b-98b9-24d7e62325f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:28.594036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814c57-0936-417b-98b9-24d7e62325f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:28.670921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-af814c57-0936-417b-98b9-24d7e62325f5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:28.672139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-af814c57-0936-417b-98b9-24d7e62325f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:28.698603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:28.769788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:28.923078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:28.924634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:29.066988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09e2b3-d330-4802-9e3a-385eeb386027 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:29.107147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:29.180329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:29.180869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:29.181142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:29.181406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:29.182968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:29.270588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:29.272268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c514-bb60-49de-9a3d-b8e65b38afe2 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:29.289934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 701/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:30.171783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:30.172342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:30.172342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:30.173720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:30.178978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd52a-1bb4-4abb-9040-4a301d72cfc8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:30.179400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd52a-1bb4-4abb-9040-4a301d72cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:30.179518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd52a-1bb4-4abb-9040-4a301d72cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:30.234772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:30.258658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-471cd52a-1bb4-4abb-9040-4a301d72cfc8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:30.259999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-471cd52a-1bb4-4abb-9040-4a301d72cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:30.356679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:30.508140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:30.509764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:30.656289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2f911-3c15-4255-8490-c02b718b0f4b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:30.668716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:30.768766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:30.769292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:30.769572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:30.769840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:30.771464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:30.860540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:30.862212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76bccf-64d6-4678-8a3e-4b3a67324089 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:30.882285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 720/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:31.777301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:31.778113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:31.778278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:31.779700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:31.785295 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775196-d53c-4b08-abec-3646b0f99ccf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:31.785713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775196-d53c-4b08-abec-3646b0f99ccf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:31.785916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775196-d53c-4b08-abec-3646b0f99ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:31.820785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:31.878234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bf775196-d53c-4b08-abec-3646b0f99ccf None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:31.879546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf775196-d53c-4b08-abec-3646b0f99ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:31.993052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:32.145287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:32.147443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:32.275279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:32.313232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c9d0f-2baa-4d13-8457-e46b260d19e6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:32.442128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:32.442730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:32.443607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:32.443881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:32.445829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:32.554593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:32.576535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:32.579912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b9e52-3b34-46e1-827d-445345db747c service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:32.603976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 704/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:33.590363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:33.590982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:33.590982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:33.592285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:33.598270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271c139-e009-4959-b16c-db25315c8d53 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:33.599972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271c139-e009-4959-b16c-db25315c8d53 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:33.600251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271c139-e009-4959-b16c-db25315c8d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:33.684560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3271c139-e009-4959-b16c-db25315c8d53 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:33.685666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3271c139-e009-4959-b16c-db25315c8d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:33.809205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:33.964259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:33.966889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:34.055458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:34.122140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29749b30-cf85-499d-98ee-dcf59bf33ddc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:34.249440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:34.250071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:34.250334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:34.250601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:34.252204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:34.304083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:34.349887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:34.351756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2ce9e-e292-4410-83e1-ec7f3821decf service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:34.370662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 723/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:35.194590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:35.195107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:35.195215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:35.196502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 16:56:35.201912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc658b2-8a20-464b-967f-fffd0244f5be None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:35.202387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc658b2-8a20-464b-967f-fffd0244f5be None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:35.202490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc658b2-8a20-464b-967f-fffd0244f5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:35.283286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-adc658b2-8a20-464b-967f-fffd0244f5be None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:35.284534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-adc658b2-8a20-464b-967f-fffd0244f5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:35.385126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:35.538452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:35.539924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:35.591673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:35.695850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20bd66b-8467-4af9-af3f-8f31d7d32de9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:35.812975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:35.813489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:35.813765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:35.814068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:35.815664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:35.823317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:35.911747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:35.913368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b76bb-d428-4460-9d7f-09aee65440e5 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:35.932470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 707/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:36.755720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:36.756292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:36.756292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:36.757698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:36.762865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0eff-636c-435b-ab07-4eb2e5348f9f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:36.763372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0eff-636c-435b-ab07-4eb2e5348f9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:36.763491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0eff-636c-435b-ab07-4eb2e5348f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:36.842569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-972a0eff-636c-435b-ab07-4eb2e5348f9f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:36.843779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-972a0eff-636c-435b-ab07-4eb2e5348f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:36.915517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:36.946670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:37.104579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:37.106112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:37.123845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:37.258061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053399c5-9504-4ebb-bf6a-33ccac812f61 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:37.347802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:37.374696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:37.375309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:37.375590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:37.375864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:37.377506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:37.474874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:37.476540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292355a5-c93a-489b-8b31-3a0c972c842e service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:37.496247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 726/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:38.314007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:38.314527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:38.314527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:38.316218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:38.321522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf731-ad65-4cde-8250-0260e789d65b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:38.322017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf731-ad65-4cde-8250-0260e789d65b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:38.322129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aaf731-ad65-4cde-8250-0260e789d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:38.402599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-38aaf731-ad65-4cde-8250-0260e789d65b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:38.403830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38aaf731-ad65-4cde-8250-0260e789d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:38.446720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:38.509683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:38.664350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:38.665892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:38.822855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1478-65c6-4e75-9d9a-3bcbe762bd94 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:38.880851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:38.950882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:38.951477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:38.951751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:38.952019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:38.953687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:39.045969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:39.047577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c6d4d-95c9-43e8-9d6f-c9304cb6a5e5 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:39.066817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 710/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:39.884241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:39.884845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:39.884845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:39.886180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 16:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:39.891483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb94e-1066-465c-9f07-70f7802b4d9f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:39.891972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb94e-1066-465c-9f07-70f7802b4d9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:39.892068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb94e-1066-465c-9f07-70f7802b4d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:39.970192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-44ccb94e-1066-465c-9f07-70f7802b4d9f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:39.971421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-44ccb94e-1066-465c-9f07-70f7802b4d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:39.973611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:40.071410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 16:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:40.223353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:40.225036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:40.501359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f1ff-26a6-43d9-9f0c-a93220286633 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:40.528776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:40.618581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:40.619192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:40.619474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:40.619744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:40.621386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:40.715255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:40.716922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792a103-4f87-449b-b416-03d263fab564 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:40.736204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 729/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:42.681926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:42.682497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:42.682497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:42.683821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:42.689557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c53-9bdd-49a0-8cb4-9f5a53b23bc7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:42.690065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c53-9bdd-49a0-8cb4-9f5a53b23bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:42.690194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b3c53-9bdd-49a0-8cb4-9f5a53b23bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:42.732646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:42.759487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7c1b3c53-9bdd-49a0-8cb4-9f5a53b23bc7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:42.760734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7c1b3c53-9bdd-49a0-8cb4-9f5a53b23bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:42.856574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 16:56:42.896283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:42.897932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:43.005125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b90cbe-ad84-4209-be0b-f0b3892cc528 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:43.038900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:43.081529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:43.082132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:43.082409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:43.082679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:43.084649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:43.197948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:43.199656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1f470-2c8a-4ebd-b735-720ed181c7e0 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:43.218064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 713/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:45.405373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:45.405998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:45.405998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:45.407533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:45.413319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee562-4c04-4daf-98b0-70dcad1fa227 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:45.413882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee562-4c04-4daf-98b0-70dcad1fa227 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:45.413882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ee562-4c04-4daf-98b0-70dcad1fa227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:45.483449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3f0ee562-4c04-4daf-98b0-70dcad1fa227 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:45.484696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3f0ee562-4c04-4daf-98b0-70dcad1fa227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:45.498511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:45.589177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:45.627919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:45.629531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:45.739634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ffc32-dc2f-4db2-9749-7f5ba6f21a9b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:45.752200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:45.817186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:45.818495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:45.818780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:45.819050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:45.820713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:45.947292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:45.949192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38587384-555d-4d33-8d24-3ac6a2eca77d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:45.971067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 732/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:48.407032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:48.407623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:48.407623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:48.409007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:48.414681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498e58-93b8-4cb4-8003-577b9101c6ad None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:48.415164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498e58-93b8-4cb4-8003-577b9101c6ad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:48.415280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498e58-93b8-4cb4-8003-577b9101c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:48.464620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:48.483484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2498e58-93b8-4cb4-8003-577b9101c6ad None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:48.484738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2498e58-93b8-4cb4-8003-577b9101c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:48.586664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:48.629118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:48.631368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:48.745801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db359c-086d-46c9-88d0-218793f89e38 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:48.789906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:48.826747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:48.827356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:48.827636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:48.827910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:48.829615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:48.941884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:48.944155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81aa30-0720-40ff-bda7-f9438427d38b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:48.963348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 716/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:51.135916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:51.136433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:51.136433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:51.137762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:51.143050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3809ac-d84f-4bb3-9b39-90d4108963a1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:51.143457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3809ac-d84f-4bb3-9b39-90d4108963a1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:51.143610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3809ac-d84f-4bb3-9b39-90d4108963a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:51.213961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd3809ac-d84f-4bb3-9b39-90d4108963a1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:51.215174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd3809ac-d84f-4bb3-9b39-90d4108963a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:51.237005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:51.313001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:51.353435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:51.355054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:51.457476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df574d4-e9d1-4a66-9328-dc83c85d7930 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:51.477831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:51.531062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:51.531693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:51.531974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:51.532247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:51.533904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:51.643182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:51.644703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4844da6-8dde-4361-a613-3c33ca0c74c0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:51.664320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 735/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:53.746945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:53.747512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:53.747635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:53.748999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:53.754962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50227-de4d-4826-b7fe-b15d688128ac None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:53.755397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50227-de4d-4826-b7fe-b15d688128ac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:53.755535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b50227-de4d-4826-b7fe-b15d688128ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:53.819387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:53.822365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-24b50227-de4d-4826-b7fe-b15d688128ac None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:53.824389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-24b50227-de4d-4826-b7fe-b15d688128ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:53.923342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:53.961902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:53.963427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:54.067941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db059-cde3-4b92-826b-e50b7916c276 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:54.117502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:54.142057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:54.142948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:54.143228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:54.143495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:54.145142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:54.264959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:54.266329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ef5c1-41a9-4725-b0ff-4147d5ced63f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:54.284802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 719/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:56.368571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:56.369111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:56.369111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:56.370377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:56.375649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db410b9-cf29-4f5b-81d3-3eaf032d1cd2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:56.376119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db410b9-cf29-4f5b-81d3-3eaf032d1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:56.376230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db410b9-cf29-4f5b-81d3-3eaf032d1cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:56.441671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2db410b9-cf29-4f5b-81d3-3eaf032d1cd2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:56.443353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2db410b9-cf29-4f5b-81d3-3eaf032d1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:56.476397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:56.546444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:56.586584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:56.588141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:56.692079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072941b-e1e2-4168-b7d0-0e1ec61eea24 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:56.720707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:56.769193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:56.769796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:56.770067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:56.770402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:56.772791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:56.881915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:56.883356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8023-8beb-47ed-b8bb-58e49305cbaa service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:56.902003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 738/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:56:59.029205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:59.029744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:59.029744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:59.031015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:56:59.036783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68dce6-7cd3-4e15-9e81-f82d0fcb17e7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:59.037449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68dce6-7cd3-4e15-9e81-f82d0fcb17e7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:59.037556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68dce6-7cd3-4e15-9e81-f82d0fcb17e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:59.102981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7b68dce6-7cd3-4e15-9e81-f82d0fcb17e7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:56:59.104186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7b68dce6-7cd3-4e15-9e81-f82d0fcb17e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:59.112252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:59.200510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:56:59.246368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:56:59.247898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:59.355336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec150ea-28b8-4723-85e7-403432766ef4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:56:59.409220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:56:59.428373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:56:59.429068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:56:59.429341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:56:59.429605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:56:59.431193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:56:59.539520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:56:59.540984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4a917-8af3-4a88-882e-68c06983ec33 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:56:59.558900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 722/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:01.631277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:01.631865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:01.631865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:01.633268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:01.638588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061501d8-1b53-49b9-8802-610b2b8690e3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:01.638997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061501d8-1b53-49b9-8802-610b2b8690e3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:01.639111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061501d8-1b53-49b9-8802-610b2b8690e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:01.706797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-061501d8-1b53-49b9-8802-610b2b8690e3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:01.708048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-061501d8-1b53-49b9-8802-610b2b8690e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:01.746736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:01.805168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:01.843045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:01.844598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:01.946966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5faa1-a29d-4569-b1c1-7b889259662f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:01.984651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:02.021200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:02.021802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:02.022078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:02.022344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:02.023912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:02.130956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:02.132401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc2ef-3699-4169-9c26-82d7faea5aa9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:02.150499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 741/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:04.308439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:04.309048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:04.309048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:04.310417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:04.315886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d1680-746d-4b04-a5ca-80dfed54033f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:04.316298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d1680-746d-4b04-a5ca-80dfed54033f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:04.316437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d1680-746d-4b04-a5ca-80dfed54033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:04.386156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-457d1680-746d-4b04-a5ca-80dfed54033f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:04.387351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-457d1680-746d-4b04-a5ca-80dfed54033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:04.404627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:04.483348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:04.521004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:04.522530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:04.625695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8b819-f197-4a0c-bda7-1a0088aa2da1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:04.692833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:04.700128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:04.700765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:04.701044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:04.701339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:04.702919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:04.811158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:04.812605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526eda6-4947-4f3b-8230-3ec0df14e327 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:04.830544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 725/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:06.833824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:06.834361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:06.834361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:06.835689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 16:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:06.841131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8968a-fead-4160-8f24-661b53b673b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:06.841567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8968a-fead-4160-8f24-661b53b673b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:06.841687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8968a-fead-4160-8f24-661b53b673b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:06.908059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b9a8968a-fead-4160-8f24-661b53b673b6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:06.909300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9a8968a-fead-4160-8f24-661b53b673b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:06.957490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:07.005734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 16:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:07.043595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:07.045180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:07.148839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4213e0-80cd-4980-92db-585aed2d9239 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:07.195867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:07.222408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:07.222934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:07.223210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:07.224016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:07.225646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:07.333522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:07.335048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9bedb-8c74-4ecc-b92c-c2bc9c247241 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:07.354425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 744/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:17.004006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=22 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:17.352184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=66 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:27.264878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a620-a6ed-47fa-be30-130d6eb5abe4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:27.265456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a620-a6ed-47fa-be30-130d6eb5abe4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:27.265456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a620-a6ed-47fa-be30-130d6eb5abe4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:27.266757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 727/1471] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:27.272670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd565f-47f9-457f-9ac2-8b5164c83e1f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:27.273165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd565f-47f9-457f-9ac2-8b5164c83e1f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:27.273343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd565f-47f9-457f-9ac2-8b5164c83e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:27.338340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1dd565f-47f9-457f-9ac2-8b5164c83e1f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:27.339546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1dd565f-47f9-457f-9ac2-8b5164c83e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:27.434015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 745/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:27.518924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:27.519151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:27.519425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:27.521475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 728/1473] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 10 16:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:27.526390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956df9-3f0b-49e7-b8af-3a049f7c929e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:27.526703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956df9-3f0b-49e7-b8af-3a049f7c929e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:27.526974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956df9-3f0b-49e7-b8af-3a049f7c929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:27.615358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4d956df9-3f0b-49e7-b8af-3a049f7c929e None None] MFA Rules not processed for user `530609a984b24349a028bcf07ae290ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:27.617519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4d956df9-3f0b-49e7-b8af-3a049f7c929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:27.640383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:27.696260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 746/1474] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 10 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:27.704102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:27.705638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:27.807801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47fb4e-8505-4c0a-a7a5-dfed94880560 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:27.881757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:27.882354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:27.882630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:27.882898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:27.884512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:27.938884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:27.995756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:27.997228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790fd99-7164-406f-80d4-0880a7c7c946 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:28.015457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 729/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:30.108382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:30.108988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:30.108988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:30.110340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 747/1476] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:30.115460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4128-153c-45e4-957d-2c9218576fa1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:30.115862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4128-153c-45e4-957d-2c9218576fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:30.116001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4128-153c-45e4-957d-2c9218576fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:30.181511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ceac4128-153c-45e4-957d-2c9218576fa1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:30.182708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ceac4128-153c-45e4-957d-2c9218576fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:30.282374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 730/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:30.305540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:30.307054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:30.435947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae663-3623-4c9c-8fc3-f3c3bcb22ad8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:30.487353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:30.539862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:30.540385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:30.540723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:30.540988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:30.541650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:30.543447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:57:30.543447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 16:57:30.543447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 16:57:30.544669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068df0c-8045-40a3-8030-0f428a3bf756 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:30.565259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 748/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 10 16:57:30 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 16:57:32.670138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:32.670706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:32.670706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:32.672024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 731/1479] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:32.677308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c869-7447-4f95-8778-d7794207c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:32.677764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c869-7447-4f95-8778-d7794207c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:32.677864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c869-7447-4f95-8778-d7794207c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:32.746398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-74e5c869-7447-4f95-8778-d7794207c0b7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:32.747617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74e5c869-7447-4f95-8778-d7794207c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:32.843125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 749/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:32.887434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:32.888965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:32.899504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:33.039259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117c30b-f858-4358-b45b-86a73b4482be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:33.119778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:33.153756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:33.154356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:33.154631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:33.154901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:33.156515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:33.258723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:33.260617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573ce32-18c0-4aea-b797-c67dad272d6b service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:33.282965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 732/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:35.776212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:35.777081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:35.777255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:35.778759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 750/1482] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:35.783939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad2eb-2824-4bd1-afaf-60837010f7f8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:35.784375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad2eb-2824-4bd1-afaf-60837010f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:35.784508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bad2eb-2824-4bd1-afaf-60837010f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:35.850995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f4bad2eb-2824-4bd1-afaf-60837010f7f8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:35.852193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f4bad2eb-2824-4bd1-afaf-60837010f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:35.899992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:35.951676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 733/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:35.987627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:35.989723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:36.013410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:36.092215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298367ed-9995-4e89-b20a-b5c7561aceab None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:36.163844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:36.164452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:36.164765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:36.165042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:36.166663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:36.241417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:36.275814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:36.277292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091d21-97e9-402e-9c36-b9c5f24193d1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:36.295209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 751/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:38.522725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:38.523278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:38.523278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:38.524659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 734/1485] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:38.530178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b970fc-4256-4cfc-a980-ce76964949a3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:38.530597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b970fc-4256-4cfc-a980-ce76964949a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:38.530776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b970fc-4256-4cfc-a980-ce76964949a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:38.610163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-39b970fc-4256-4cfc-a980-ce76964949a3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:38.611362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39b970fc-4256-4cfc-a980-ce76964949a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:38.722513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 752/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:38.765092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:38.766641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:38.875195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f59869-b5b2-4cbe-be89-0799220eed93 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:38.947854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:38.949855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:38.950754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:38.951019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:38.951492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:38.953500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:39.062349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:39.063770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21057c17-289b-49b1-8802-7bf985e8d94d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:39.083413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 735/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 16:57:41.259112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:41.259682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:41.259682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:41.261034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 753/1488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:41.266361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac183e-068a-48b9-a68c-a480d6422971 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:41.266804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac183e-068a-48b9-a68c-a480d6422971 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:41.266915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac183e-068a-48b9-a68c-a480d6422971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:41.333291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-00ac183e-068a-48b9-a68c-a480d6422971 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:41.334491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00ac183e-068a-48b9-a68c-a480d6422971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:41.387109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:41.431686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 736/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:41.474066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:41.475593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:41.511169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:41.585839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce907-e9df-4a34-9a27-504217e08c40 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:41.659496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:41.660109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:41.660462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:41.660895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:41.662535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:41.742725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:41.773220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:41.774586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab93745-8390-442d-b45c-d04eb5d4ae6d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:41.792501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 754/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:44.054244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:44.054774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:44.054774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:44.056204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 737/1491] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 10 16:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:57:44.061579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e50f-b7aa-4a17-b109-e0a39fff99f0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:44.062020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e50f-b7aa-4a17-b109-e0a39fff99f0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:44.062128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e50f-b7aa-4a17-b109-e0a39fff99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:44.130879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1679e50f-b7aa-4a17-b109-e0a39fff99f0 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:57:44.132090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1679e50f-b7aa-4a17-b109-e0a39fff99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:44.229222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 755/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 10 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:57:44.270703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:57:44.272225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:44.384153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd1b6c-3591-4d92-abe6-77c7cab399b1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:57:44.457001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:57:44.457694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:57:44.457972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:57:44.458242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:57:44.459848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:57:44.469447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:44.570674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:57:44.572017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1c04-cee0-432e-9826-38dbb941506e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:57:44.590645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 738/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:57:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:57:54.227414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:57:54.588439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=50 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:04.343236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:04.343796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:04.343796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:04.421857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:59:04.423167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:04.517849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 756/1494] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:59:04.526745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:04.527249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:04.527363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:04.603946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:59:04.605097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:04.700844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 739/1495] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:59:04.705752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:04.707580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:04.718825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1a68b-1ec7-4825-99df-1c026003f41f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:04.781059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:04.815607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:04.816759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:04.817033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:04.817299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:04.817937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 16:59:04.818232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:04.819246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:04.819246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 16:59:04.819246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 16:59:04.820124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:04.831395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 757/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 16:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 16:59:04.840007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:04.849545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47411b83-a110-43bb-95ee-5ed969772050 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:04.909073 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:04.943146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:04.943747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:04.944027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:04.944293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:04.944936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:04.946668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:04.946668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 16:59:04.946668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 16:59:04.947854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:05.002653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 740/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 16:59:04 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:59:05.007106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:05.008667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:05.043844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44634e6-8d0b-481e-b526-8e155de92c55 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:05.136431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:05.137062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.137342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.137614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.138229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:05.139249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:05.139249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 16:59:05.139249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 16:59:05.140442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:05.185490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 758/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 16:59:05 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 16:59:05.187228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:05.189010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:05.254733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef5cad-caca-454f-b26e-3dfe5a140f20 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:05.338145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.350907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:05.351510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.351786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.352054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.352723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:05.353727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:05.353727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 16:59:05.353727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 16:59:05.354625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:05.366885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 741/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 16:59:05.371077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:05.372649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:05.384661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda766-9f76-4524-8e66-3ed14a43d131 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:05.409623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.481440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:05.481958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.482230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.482493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.483124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:05.484130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:05.484130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 16:59:05.484130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 16:59:05.485049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deba8e-2b65-4da6-a888-b0996d24feb0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:05.497879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 759/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 16:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 16:59:05.502138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:05.504295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:05.538925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aab367-d729-454d-96c7-cd8fbec0cee7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:05.633508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:05.634159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.634436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.634705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] PATH_INFO: `/v3/projects/56bac464a92947febb559f0cc3e0c3a5/users/fe24ffcb915c47ec9ea68f18479c9962/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.656323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bac464a92947febb559f0cc3e0c3a5, user_id=fe24ffcb915c47ec9ea68f18479c9962, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:05.657369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:05.657369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 16:59:05.657369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 16:59:05.659338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dd48d-8975-4ded-895e-ded016d15546 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:05.683851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 742/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 16:59:05 2022] PUT /identity/v3/projects/56bac464a92947febb559f0cc3e0c3a5/users/fe24ffcb915c47ec9ea68f18479c9962/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 16:59:05.697004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392263-a263-4be4-a841-d78d82c4c375 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.697291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392263-a263-4be4-a841-d78d82c4c375 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.697567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392263-a263-4be4-a841-d78d82c4c375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.755670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-49392263-a263-4be4-a841-d78d82c4c375 None None] MFA Rules not processed for user `fe24ffcb915c47ec9ea68f18479c9962`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:59:05.756872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-49392263-a263-4be4-a841-d78d82c4c375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:05.835530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 760/1502] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:59:05.848783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.849066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.849339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.850688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 743/1503] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 10 16:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:59:05.855448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360acb-bd35-427b-8ee8-db3bf6b1565f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:05.855734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360acb-bd35-427b-8ee8-db3bf6b1565f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:05.856006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22360acb-bd35-427b-8ee8-db3bf6b1565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:05.889028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:05.936707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-22360acb-bd35-427b-8ee8-db3bf6b1565f None None] MFA Rules not processed for user `fb66e8f0439d48fd9805921211801b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:59:05.937905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-22360acb-bd35-427b-8ee8-db3bf6b1565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.013659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 761/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 10 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:59:06.021910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:06.023419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.074280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:06.130410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b894c4-a866-43da-aebe-d11b8c8b43da None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:06.204145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:06.204776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:06.205054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:06.205320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:06.207181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.306304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:06.307634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:06.311120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:06.325824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 744/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:59:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 16:59:06.372593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51792dc-8c4a-4b29-9496-2274cf2ef985 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:06.373026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51792dc-8c4a-4b29-9496-2274cf2ef985 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:06.373141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51792dc-8c4a-4b29-9496-2274cf2ef985 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:06.374397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 762/1506] 10.222.0.39 () {52 vars in 830 bytes} [Wed Aug 10 16:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 16:59:06.378168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:06.379380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.478926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424e692-60dc-4b5a-95d3-43a9fdaca2db service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:06.573502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:06.574183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:06.574294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:06.574560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] PATH_INFO: `/v3/users/fe24ffcb915c47ec9ea68f18479c9962` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:06.587625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe24ffcb915c47ec9ea68f18479c9962)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:06.588986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:06.588986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 16:59:06.588986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 16:59:06.590207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:06.601428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:06.660930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe24ffcb915c47ec9ea68f18479c9962'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:06.684045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe24ffcb915c47ec9ea68f18479c9962'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:06.698617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe24ffcb915c47ec9ea68f18479c9962'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:06.699106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe24ffcb915c47ec9ea68f18479c9962'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:06.699640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe24ffcb915c47ec9ea68f18479c9962'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:06.716310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 745/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 16:59:06 2022] DELETE /identity/v3/users/fe24ffcb915c47ec9ea68f18479c9962 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:59:06.720802 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:06.721095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:06.721369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:06.779105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 16:59:06.780311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.861789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:06.876565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 763/1508] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 16:59:06.889813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:06.891028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:06.990538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12810ec-49b9-44b2-9c0d-06f7aa089a52 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:07.045128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:07.066753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:07.067226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:07.067506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:07.067775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:07.069436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:07.182252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:07.183811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d438-4664-4a83-9d9c-71f1475d2de2 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:07.211952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 746/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 16:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 16:59:07.540752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 16:59:07.542003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 16:59:07.554032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ae5ef-66b1-4835-9704-6020478d34d2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 16:59:07.651432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 16:59:07.652076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 16:59:07.652357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 16:59:07.652668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] PATH_INFO: `/v3/projects/56bac464a92947febb559f0cc3e0c3a5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 16:59:07.663774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bac464a92947febb559f0cc3e0c3a5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 16:59:07.664843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 16:59:07.664843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 16:59:07.664843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 16:59:07.666046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 16:59:07.724567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bac464a92947febb559f0cc3e0c3a5', 'request_id': 'req-309583ff-a1b4-4309-86eb-abc72275442c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:07.730428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bac464a92947febb559f0cc3e0c3a5', 'request_id': 'req-309583ff-a1b4-4309-86eb-abc72275442c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:07.740762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bac464a92947febb559f0cc3e0c3a5', 'request_id': 'req-309583ff-a1b4-4309-86eb-abc72275442c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:07.770201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] The token cache is being invalidate because project 56bac464a92947febb559f0cc3e0c3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 16:59:07.770491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:07.771015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309583ff-a1b4-4309-86eb-abc72275442c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 16:59:07.772319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 764/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 16:59:07 2022] DELETE /identity/v3/projects/56bac464a92947febb559f0cc3e0c3a5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 16:59:17.209336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=62 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 16:59:17.767673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:49.309969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:49.310570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:49.310570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:49.311876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 17:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:00:49.317414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a65e1-45cd-46e4-879f-c4984428e988 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:49.317870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a65e1-45cd-46e4-879f-c4984428e988 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:49.317974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a65e1-45cd-46e4-879f-c4984428e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:49.401695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6f7a65e1-45cd-46e4-879f-c4984428e988 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:00:49.402906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f7a65e1-45cd-46e4-879f-c4984428e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:00:49.508794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:00:49.665977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:00:49.668056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:00:49.789513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a7f5a-9403-4951-9a0c-1e64bf4440c4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:00:49.794830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:00:49.795428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:49.795704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:49.795975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:49.803978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:00:49.805574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bf309-eac4-43f4-9c16-09cb1d192988 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:00:49.814708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 748/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:00:50.651270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5ed-4b5e-4173-98e0-733a4362e49c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:50.651868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5ed-4b5e-4173-98e0-733a4362e49c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:50.651868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c5ed-4b5e-4173-98e0-733a4362e49c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:50.653221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 17:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:00:50.658241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cecb0-08de-4176-b02e-85c881a6ed2d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:50.658692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cecb0-08de-4176-b02e-85c881a6ed2d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:50.658802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cecb0-08de-4176-b02e-85c881a6ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:50.678331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e1cecb0-08de-4176-b02e-85c881a6ed2d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:00:50.679504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e1cecb0-08de-4176-b02e-85c881a6ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:00:50.687249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 17:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:00:50.840743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c5ed-4b5e-4173-98e0-733a4362e49c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:00:50.855875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c5ed-4b5e-4173-98e0-733a4362e49c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:00:50.861359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:00:50.861955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:50.862245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:50.862519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:50.872694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:00:50.874297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cd227-0a8e-4919-89f2-18a3f6a99e5a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:00:50.883755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 767/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:00:51.479832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ef1c-5fde-40a7-9e83-644c0c0d17ce None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:51.480113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ef1c-5fde-40a7-9e83-644c0c0d17ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:51.480386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ef1c-5fde-40a7-9e83-644c0c0d17ce None None] PATH_INFO: `/v3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:51.481700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 750/1517] 10.222.0.13 () {54 vars in 925 bytes} [Wed Aug 10 17:00:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:00:51.489990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0d54-6321-4e5e-bd87-5748a58afbcc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:00:51.490280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0d54-6321-4e5e-bd87-5748a58afbcc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:00:51.490555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a0d54-6321-4e5e-bd87-5748a58afbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:00:51.551982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-020a0d54-6321-4e5e-bd87-5748a58afbcc None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:00:51.553267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-020a0d54-6321-4e5e-bd87-5748a58afbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:00:51.570366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:00:51.625930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 768/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 10 17:00:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:00.673105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=56 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:01.449448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8773f-3acf-49fd-98a3-63f651d80ca1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:01.449655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8773f-3acf-49fd-98a3-63f651d80ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:01.449908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8773f-3acf-49fd-98a3-63f651d80ca1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:01.451656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 751/1519] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 10 17:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:01.458230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6f43e-6e8d-44f1-b57e-b928c1963204 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:01.458708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6f43e-6e8d-44f1-b57e-b928c1963204 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:01.458839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6f43e-6e8d-44f1-b57e-b928c1963204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:01.479838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f2b6f43e-6e8d-44f1-b57e-b928c1963204 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:01.481057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2b6f43e-6e8d-44f1-b57e-b928c1963204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:01.495585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 769/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 10 17:01:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:01.502949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8773f-3acf-49fd-98a3-63f651d80ca1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:01.518982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8773f-3acf-49fd-98a3-63f651d80ca1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:01.525098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:01.525701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:01.525978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:01.526246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:01.534991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:01.536589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ccf6b-e5e5-4c1c-a395-d4886c9455bd service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:01.547540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 752/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:02.272801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207001-b4b6-46ed-ab5d-47f572ab17d9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:02.273864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207001-b4b6-46ed-ab5d-47f572ab17d9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:02.274141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47207001-b4b6-46ed-ab5d-47f572ab17d9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:02.275538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 17:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:02.280529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43c55-7674-4b13-8d53-05cdb892c4e1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:02.281008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43c55-7674-4b13-8d53-05cdb892c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:02.281102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43c55-7674-4b13-8d53-05cdb892c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:02.300180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2ac43c55-7674-4b13-8d53-05cdb892c4e1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:02.301412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2ac43c55-7674-4b13-8d53-05cdb892c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:02.310306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:02.470198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207001-b4b6-46ed-ab5d-47f572ab17d9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:02.488804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47207001-b4b6-46ed-ab5d-47f572ab17d9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:02.495365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:02.495965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:02.496242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:02.496540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:02.505142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:02.506735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f72046-44e5-4b7b-b4f2-7eaf16cdd823 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:02.516803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 771/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:03.340602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3233-3049-40ac-bfec-49c76c55a8fe None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:03.341181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3233-3049-40ac-bfec-49c76c55a8fe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:03.341181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3233-3049-40ac-bfec-49c76c55a8fe None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:03.342594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 17:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:03.349196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb627e7-a759-45bf-831b-97a8aeccd3dd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:03.349711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb627e7-a759-45bf-831b-97a8aeccd3dd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:03.350246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb627e7-a759-45bf-831b-97a8aeccd3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:03.370378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9bb627e7-a759-45bf-831b-97a8aeccd3dd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:03.371582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9bb627e7-a759-45bf-831b-97a8aeccd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:03.379462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 17:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:03.532331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c3233-3049-40ac-bfec-49c76c55a8fe None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:03.547363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c3233-3049-40ac-bfec-49c76c55a8fe None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:03.552809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:03.553400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:03.553681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:03.553953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:03.562972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:03.564577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004653cf-73e0-4395-a003-e6f615f13143 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:03.574135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 755/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:07.676805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:07.677374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:07.677374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:07.678727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 17:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:07.684750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd840-9238-45e8-836d-d271ddd71b45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:07.685183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd840-9238-45e8-836d-d271ddd71b45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:07.685340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbd840-9238-45e8-836d-d271ddd71b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:07.705347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aabbd840-9238-45e8-836d-d271ddd71b45 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:07.706540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aabbd840-9238-45e8-836d-d271ddd71b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:07.715129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:07.787741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:07.789680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:07.868704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2577e-e96f-4229-9e85-6e515e544f12 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:07.872397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:07.873037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:07.873320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:07.873591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:07.882638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:07.884602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e08a3c-570e-4a52-81ec-7bfec5fe4981 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:07.893827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 774/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:09.911055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad24e-cf98-4550-87bc-a7248d273bbd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:09.913176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad24e-cf98-4550-87bc-a7248d273bbd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:09.913176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ad24e-cf98-4550-87bc-a7248d273bbd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:09.913972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 17:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:09.920263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7aac-4e48-453f-9391-2515f41ca34d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:09.920779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7aac-4e48-453f-9391-2515f41ca34d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:09.920893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7aac-4e48-453f-9391-2515f41ca34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:09.940621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e54c7aac-4e48-453f-9391-2515f41ca34d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:09.941740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e54c7aac-4e48-453f-9391-2515f41ca34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:09.949960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 17:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:09.987089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad24e-cf98-4550-87bc-a7248d273bbd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:09.998423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ad24e-cf98-4550-87bc-a7248d273bbd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:10.002089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:10.002686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:10.002964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:10.003235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:10.012839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:10.014265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de2459-7799-4ef1-b5ae-577b6c1c34b9 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:10.024205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 758/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:13.566931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:13.567511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:13.567511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:13.568861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 17:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:13.574904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652dd1-e9c8-452f-bca6-1c23ccab01ef None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:13.575345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652dd1-e9c8-452f-bca6-1c23ccab01ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:13.575457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652dd1-e9c8-452f-bca6-1c23ccab01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:13.594679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-de652dd1-e9c8-452f-bca6-1c23ccab01ef None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:13.595883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-de652dd1-e9c8-452f-bca6-1c23ccab01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:13.603862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 17:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:13.909120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:13.910935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:13.975188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:13.989120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f442ef-3020-4040-994c-af1efa39731d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:13.993953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:13.994559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:13.994862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:13.995132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:14.004286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:14.005757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba38f4c-a2e7-4e15-95cb-e761c0b4c35e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:14.015370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 777/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:16.055878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:16.056452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:16.056452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:16.057741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 17:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:01:16.063359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3e76-836c-443e-add6-683fd2cf7e02 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:16.063829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3e76-836c-443e-add6-683fd2cf7e02 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:16.063931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3e76-836c-443e-add6-683fd2cf7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:16.084681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-43cb3e76-836c-443e-add6-683fd2cf7e02 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:01:16.085942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43cb3e76-836c-443e-add6-683fd2cf7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:16.094193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 17:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:01:16.396803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:01:16.399289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:01:16.412056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2aa4b-2363-4608-ac06-e387e3f38561 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:01:16.415664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:01:16.416253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:01:16.416568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:01:16.416845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:01:16.426971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:01:16.428390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b512a54-99ad-4749-bea4-320520d48679 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:01:16.438177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 761/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:01:26.079787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=11 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:01:26.433945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=33 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:45.434348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97031a-79c3-4f63-9f7b-5b01895a3c77 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.435474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97031a-79c3-4f63-9f7b-5b01895a3c77 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.435859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97031a-79c3-4f63-9f7b-5b01895a3c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.467153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e97031a-79c3-4f63-9f7b-5b01895a3c77 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.468810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e97031a-79c3-4f63-9f7b-5b01895a3c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.468961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c242c-bef1-425a-8b13-c7c4017ebf6c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.469458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c242c-bef1-425a-8b13-c7c4017ebf6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.469458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c242c-bef1-425a-8b13-c7c4017ebf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.489833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 779/1540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.505806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ac0c242c-bef1-425a-8b13-c7c4017ebf6c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.508787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac0c242c-bef1-425a-8b13-c7c4017ebf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.512874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ce0a-b4f1-42fc-b162-9a7bed73b00a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.513623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ce0a-b4f1-42fc-b162-9a7bed73b00a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.514103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ce0a-b4f1-42fc-b162-9a7bed73b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.535311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 762/1541] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.536712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.536999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.537266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.557743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9e15ce0a-b4f1-42fc-b162-9a7bed73b00a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.559350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e15ce0a-b4f1-42fc-b162-9a7bed73b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.575046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.576441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.587723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 780/1542] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:02:45.589394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.589906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.590395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.593774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 763/1543] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.595142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.611687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d233eab-21af-4ee3-b2cf-ad8a2f1f5654 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.617360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.618390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.618911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.619426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.620379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:45.620971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.622416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:45.622416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 17:02:45.622416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 17:02:45.623895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c81f-b25b-4858-8fa5-428621792885 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.631007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.632813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.651249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 764/1544] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:45.653150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.653675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.654191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.662533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 781/1545] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.662533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.690599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee67386-4b6a-44f5-ac0d-cdbf3205d88b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.691696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.693165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.707713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 765/1546] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.712606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.720532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.720532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.720532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.720532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.721098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.721098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:45.721098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 17:02:45.721098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 17:02:45.721990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63659b25-62a0-4c34-9855-bd3fe0a4282b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.728913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d22f55-0bc9-4bc6-87a8-19e3da42a1cc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.736737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.737502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.737905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.738285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.739045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:45.739455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.741197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.762737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 766/1547] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:45.763868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.780094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae48ff6-c58d-4d3a-875e-17cc7a1a3506 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.788213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.789546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.789902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.790252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.790723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 782/1548] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:45.791718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:45.792017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.792136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.792306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.792611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.793920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.822705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 767/1549] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:45.823898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.828196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.833612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.841616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb4a7e-73c5-4655-a6ad-db666767a141 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.929002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.929640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.929908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.930186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.930812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.932721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4134d-c0fe-4497-a80c-c0441fc18992 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.937104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 783/1550] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:45.938063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.954500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139439-15e7-4c22-a99d-b99eaaaacf03 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:45.960777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:45.961464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.961747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.961938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.962568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:45.964657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:45.966164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 768/1551] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:45.969953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54623d-8126-4080-bada-7533bdbe112d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:45.970240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54623d-8126-4080-bada-7533bdbe112d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:45.970518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54623d-8126-4080-bada-7533bdbe112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:45.986759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 784/1552] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/users => generated 283 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:45.987564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:45.991149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6b54623d-8126-4080-bada-7533bdbe112d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:45.992416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6b54623d-8126-4080-bada-7533bdbe112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:45.999967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3958a00-d557-4273-8fcc-bcb0a1a3a68e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.055431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.056039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.056328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.056637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.063704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 769/1553] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.063851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.063937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cdb5-fe09-477f-94f9-31caade5a051 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.063937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cdb5-fe09-477f-94f9-31caade5a051 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.063937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cdb5-fe09-477f-94f9-31caade5a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.064162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4badd4-b8f0-44b5-affd-c6dd35655c6e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.078693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c061cdb5-fe09-477f-94f9-31caade5a051 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.080285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c061cdb5-fe09-477f-94f9-31caade5a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.089678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 770/1554] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.094497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 785/1555] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:45 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.094497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdc08-d2a2-4a8f-af25-7f034443f15a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.094497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdc08-d2a2-4a8f-af25-7f034443f15a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.094497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdc08-d2a2-4a8f-af25-7f034443f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.096299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.096620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.097060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.114473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ceffdc08-d2a2-4a8f-af25-7f034443f15a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.115684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ceffdc08-d2a2-4a8f-af25-7f034443f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.116093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.117443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.128249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.130289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.180684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 786/1556] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.180879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 771/1557] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.181636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.181950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.182236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.182509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.202487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba798-3ded-429b-adf6-710144897af7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.202951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.204425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.207403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.208003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.208278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.208569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.209186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.210267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:46.210267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 17:02:46.210267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 17:02:46.212801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb45b1-2e25-43eb-8b13-2f297eb3f9a0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.213335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 787/1558] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.214190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.224282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08182b-1e48-4e97-8491-38241f4d3d5a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.230619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.231437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.232050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.232674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.233625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.235835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.237673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 772/1559] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/users => generated 286 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.238904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d667fa-3dee-4097-81c8-9b7769e03d93 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.239185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d667fa-3dee-4097-81c8-9b7769e03d93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.239453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d667fa-3dee-4097-81c8-9b7769e03d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.250427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 788/1560] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.251317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.261110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-09d667fa-3dee-4097-81c8-9b7769e03d93 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.262309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-09d667fa-3dee-4097-81c8-9b7769e03d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.265465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2840749-a9f6-422d-9eb6-0abbf7e24bb4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.270497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.271102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 773/1561] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.271221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.271376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.271650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.272299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e48-e991-44dd-bc36-5dae19a61152 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.272416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.272608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e48-e991-44dd-bc36-5dae19a61152 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.273542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246e48-e991-44dd-bc36-5dae19a61152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.275523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d132-1845-4a9f-8150-3982ae4c7760 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.294359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-49246e48-e991-44dd-bc36-5dae19a61152 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.295545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49246e48-e991-44dd-bc36-5dae19a61152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.299337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 789/1562] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.300598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.300887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.301161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.303776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 774/1563] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.305659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.305938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.306209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.324917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.326144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.327629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.328834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.334719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 790/1564] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.339233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 775/1565] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:46.339233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.340466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.350667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3a06f-33ea-4911-9780-8a22fad16d58 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.351103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da699-1ce0-4d47-9536-d957113a4411 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.355629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.356011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.356221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.356534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.356688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.356809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.357004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.357208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.357448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:46.357752 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.357857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.359342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.359460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.370694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 791/1566] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.373478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 776/1567] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:46.381753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.381948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.394055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5890c7-d5d7-4c6b-9760-a4b23eaf8519 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.394952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89d30-3120-45a2-b3e8-44743e53f5c2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.400175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.400339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.400826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.400939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.401119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.401221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.401397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.401510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.402026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.402139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:46.402323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.403623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.403884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.413881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 792/1568] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.415038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.420353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 777/1569] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:46.420353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.425356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed2ecc-0f09-4908-ab34-e5fbe1a2a811 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.431058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18552d4-5545-4fb9-894f-687861eb8441 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.433300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.433925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.434207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.434478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.435124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.435841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.436432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.436738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.436847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.437099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.437746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:46.438052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.439617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.450933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 793/1570] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.450933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.459689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 778/1571] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:46.459689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.464733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179c49-a6f1-4b22-b8f6-858be48f45c1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.465915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19375a8-06b4-439d-ac13-805e7ac84a50 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.469504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.470099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.470377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.470648 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.470760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.471285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:46.471400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.471587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.471685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.471855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.472532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:02:46.472935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.473360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.474509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.486220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 779/1572] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:46.494501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 794/1573] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:02:46.494626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.494732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.499866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af9dd-cee2-4469-938e-fa57b0ab7bf3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.504149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202546-2ef6-4c8d-81f9-2628c4763bf4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.505731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.506404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.506744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.507020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.509166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.509873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.510408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.510645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.510842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.511287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.512775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.512888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.524078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 780/1574] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.524959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.537911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2f77d-d653-4e0f-be7d-8490ec00d031 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.543372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2148-0825-4849-b766-424613f729ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.544018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2148-0825-4849-b766-424613f729ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.544296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2148-0825-4849-b766-424613f729ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.544409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 795/1575] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.544618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2148-0825-4849-b766-424613f729ff admin admin] PATH_INFO: `/v3/projects/4a744dc709ba4b88a78ff0fc16c3d4eb/users/e624f5a4a24b489b839a56762853fb23/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.545243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.560141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a2148-0825-4849-b766-424613f729ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a744dc709ba4b88a78ff0fc16c3d4eb, user_id=e624f5a4a24b489b839a56762853fb23, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.562836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a2148-0825-4849-b766-424613f729ff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.577751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 781/1576] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:46 2022] PUT /identity/v3/projects/4a744dc709ba4b88a78ff0fc16c3d4eb/users/e624f5a4a24b489b839a56762853fb23/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:46.578436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2148-0825-4849-b766-424613f729ff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.612416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f9464-41b4-44a7-b67e-4513098a7cbe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.625030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.642407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.647515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2148-0825-4849-b766-424613f729ff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.654486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.655094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.655376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.655650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.656302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.657950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.669128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 782/1577] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:46.669961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.679439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099677-6644-417b-95a9-715bfea6a2ec admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.681060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.681681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.681960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.682233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.682858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.684079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.687346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.687346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.687346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.687674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.687754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.687754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.714274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 796/1578] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.717431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 783/1579] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.718184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.721128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.781711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e5a7b-54f8-4b7a-bf4b-9a760544b28d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.784041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f024-734f-45a6-828e-8984dcb37e54 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.786624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.787219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.787500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.787770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.789019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.789306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.789969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.790260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.790591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.791122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.791233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.793164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.817568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 784/1580] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.818619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.824524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 797/1581] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.826746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.881589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e6d17-ccd2-4e0f-9b36-191c7586f145 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.887110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.887765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.888048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.888353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] PATH_INFO: `/v3/projects/5c35a64923884f39a051434cc041d7b3/users/56e3e3e106304be782bf64b6fed20a37/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.888877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e91-c184-4798-bb2a-9f731d9a514f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.893613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:46.894210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.894491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.894764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.895387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.897339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.904207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c35a64923884f39a051434cc041d7b3, user_id=56e3e3e106304be782bf64b6fed20a37, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:46.906879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1146542-51c6-47cb-8396-0b287c97c6e6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:46.921035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 785/1582] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:46 2022] PUT /identity/v3/projects/5c35a64923884f39a051434cc041d7b3/users/56e3e3e106304be782bf64b6fed20a37/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:46.924429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 798/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:46.924429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:46.924766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:46.924766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:46.924766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:46.935556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962b41e-ca88-45f5-927f-ab8c35e09b9a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:46.948096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:46.953067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] MFA Rules not processed for user `e624f5a4a24b489b839a56762853fb23`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:46.954549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:46.983813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:47.000195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.000892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.001173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.001456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] PATH_INFO: `/v3/projects/018c96b8bfae4a0b92be12154d81d83a/users/955e27b73d0f42698dcb99d7f3be3178/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.015889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018c96b8bfae4a0b92be12154d81d83a, user_id=955e27b73d0f42698dcb99d7f3be3178, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.016990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:47.016990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 17:02:47.016990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 17:02:47.018989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.023687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 786/1584] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:47.025289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.034455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 799/1585] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:46 2022] PUT /identity/v3/projects/018c96b8bfae4a0b92be12154d81d83a/users/955e27b73d0f42698dcb99d7f3be3178/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:47.035266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.043395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0f8f-9694-45bc-8292-224f486460b9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.100599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e615c-6d78-452c-8ea8-cdf9ce18b7a4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.103228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.103871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.104153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.104442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.105095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.105970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.106594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.106905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.107070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.107181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.107806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.109724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.136447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 787/1586] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.136447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.136794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 800/1587] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.136794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.142096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03aa41-12fd-4642-8d5c-9a58c312ede2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.142740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ffc77-d448-4511-ac8a-c51e130baf01 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.146688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.147280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.147404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.147571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.148443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.148608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.148856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.149186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.149298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.149735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.151035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ac2b-6ff0-4f00-89c5-5b6490f3fc5d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.151645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.175390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 801/1588] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.175390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.175684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 788/1589] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.175684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899378d-7deb-4609-9f86-6987b66264bc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.175684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899378d-7deb-4609-9f86-6987b66264bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.175906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899378d-7deb-4609-9f86-6987b66264bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.186316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942f227-70f3-459c-8eac-bf17247ef23b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.190842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.191432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.191709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.191980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.192637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.194212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.203560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f899378d-7deb-4609-9f86-6987b66264bc None None] MFA Rules not processed for user `56e3e3e106304be782bf64b6fed20a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:47.205057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f899378d-7deb-4609-9f86-6987b66264bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:47.205760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 802/1590] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.206676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.263733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14070d14-b18d-4c57-b133-e650a54d3211 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.267287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.267900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.268196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.268462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.275117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 789/1591] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:47.279987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.280290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.280591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.284648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:47.301957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:47.303174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:47.315019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 790/1592] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:47.315850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.327297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe8fd-f096-495e-a9c5-ca0ec68d32f8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.332315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.333057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.333341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.333500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.333603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.334244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.334942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.335900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.344628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 803/1593] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:47.345452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.346561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 791/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.347659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.357232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c9bb9-b36a-4f53-af27-2a9b30bf734b service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.360862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2065c-41be-47e0-ab34-f6fb9c743029 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.362200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.362704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.362990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.363535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.364101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.366088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.366371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.367227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.367912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.367912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.368441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.370250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.375631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:47.381774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 804/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.381774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.384796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 792/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.386227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.392123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904fdb8-2ed2-4c14-a36e-629117e41ec7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.397251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.398421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.398708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.398986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.399373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09119155-38b9-4ed5-8404-d62fcf194d1c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.399632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.401277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.405399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.406194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.407098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.407540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.408768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.410520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.415361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 805/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.415361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.427151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 793/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.427151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.427513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e25b9-64f1-488a-92cb-7d8d41f0bd02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.433040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.433659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.433938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.434221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.434848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.437412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.470796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 806/1599] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.473368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.490910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42053117-0f1d-4248-919e-b418e004caff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.543829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.544440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.544757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.545032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.555146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b58b2d-41b7-4406-8499-7543383cb61a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.555378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.556876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.561603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.562229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.562509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.562781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.563425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.565438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.566691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 794/1600] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:47.567438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.579754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96284cc-5e77-4199-94a4-38ce9b13d8be service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.581687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 807/1601] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.582587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.584978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.586496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.586496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.586496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.587247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.588878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.593260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa615ab-9908-4888-a056-263ee0c99c43 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.600340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.601724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.602016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.602293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.603142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.604603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 795/1602] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.604873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.606410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.616835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 808/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.617814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.622935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d6573-a826-4b13-b367-9e7928791da3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.628794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.629552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.629900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.630629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.631569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.634058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b1cf4-6b41-47c3-af57-37d3eee7fec2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.634592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.640133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.641180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.641673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.641960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] PATH_INFO: `/v3/projects/6dabf25d5f3d47439797c23bb3627520/users/508fe245e731449da94b0a7abf895f8f/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.651762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 796/1604] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:47.654471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.666314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a03aeb-27d6-4715-829a-3163a5570925 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.669019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dabf25d5f3d47439797c23bb3627520, user_id=508fe245e731449da94b0a7abf895f8f, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.672725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.673207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.673432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.673703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.674075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.674971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.677373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.697909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 809/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:47 2022] PUT /identity/v3/projects/6dabf25d5f3d47439797c23bb3627520/users/508fe245e731449da94b0a7abf895f8f/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:47.700115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.718680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 797/1606] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:47 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:47.719905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.732621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a65242-0135-4381-ae35-e4ff86432ad9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.753442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:47.799011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014e4cf-c19c-40d5-b183-66b556cad3bc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.805748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.806848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.807132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.807686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] PATH_INFO: `/v3/projects/2b6e9e5dcd3448609044bfd81cf430e6/users/c1240766f4a143a3ba2bcbdf35521959/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.819846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:47.821184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:47.821749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:47.822374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] PATH_INFO: `/v3/projects/0a504773617744f493330e22bdc139e5/users/8f75312554114e81a2720c44ffc3ec3a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:47.827290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6e9e5dcd3448609044bfd81cf430e6, user_id=c1240766f4a143a3ba2bcbdf35521959, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.831589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.841874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:47.846576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a504773617744f493330e22bdc139e5, user_id=8f75312554114e81a2720c44ffc3ec3a, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:47.852999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:47.854941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 810/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:47 2022] PUT /identity/v3/projects/2b6e9e5dcd3448609044bfd81cf430e6/users/c1240766f4a143a3ba2bcbdf35521959/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:47.856065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.876341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 798/1608] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:47 2022] PUT /identity/v3/projects/0a504773617744f493330e22bdc139e5/users/8f75312554114e81a2720c44ffc3ec3a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:47.876341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:47.947215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9d85b-0b85-4400-b230-ed67392062ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:47.994572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8194-512b-42c8-8a24-2de20aa2f614 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.006491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.007769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.008827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.009383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] PATH_INFO: `/v3/projects/fda4b8a82dc048e88b86b5dbc9a943ce/users/73a054a9f4ab46f9bc8d573236176b92/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.042470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.043264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.043665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.044288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] PATH_INFO: `/v3/projects/9bab0dbd4e67412783038c71b8aa0c71/users/293351869c8f45688bb70ffc1e812485/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.057818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda4b8a82dc048e88b86b5dbc9a943ce, user_id=73a054a9f4ab46f9bc8d573236176b92, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.061359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.067539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bab0dbd4e67412783038c71b8aa0c71, user_id=293351869c8f45688bb70ffc1e812485, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.072870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458c8fa-74b3-4d6f-8899-93163f46bdd6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.095461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 811/1609] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:47 2022] PUT /identity/v3/projects/9bab0dbd4e67412783038c71b8aa0c71/users/293351869c8f45688bb70ffc1e812485/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:48.095461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76db0f-f058-4bbb-9cbe-de5ca69f80aa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.095461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76db0f-f058-4bbb-9cbe-de5ca69f80aa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.095461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76db0f-f058-4bbb-9cbe-de5ca69f80aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.097857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 799/1610] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:47 2022] PUT /identity/v3/projects/fda4b8a82dc048e88b86b5dbc9a943ce/users/73a054a9f4ab46f9bc8d573236176b92/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:48.098614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.121327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-df76db0f-f058-4bbb-9cbe-de5ca69f80aa None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:48.122551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-df76db0f-f058-4bbb-9cbe-de5ca69f80aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:48.175588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:48.178748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d0ad-364f-468e-96a9-861045d8e29c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.206606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 812/1611] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:48.210709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f7a5-f75f-4ef7-b546-5fb7042211cc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.211127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f7a5-f75f-4ef7-b546-5fb7042211cc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.211466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f7a5-f75f-4ef7-b546-5fb7042211cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.244840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9d05f7a5-f75f-4ef7-b546-5fb7042211cc None None] MFA Rules not processed for user `c1240766f4a143a3ba2bcbdf35521959`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:48.246093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9d05f7a5-f75f-4ef7-b546-5fb7042211cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:48.260654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.261279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.261561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.261832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.262481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.265032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899a495-16e3-4e87-bcb8-d2d54208d7c4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.280236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 800/1612] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:48.280236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18d241-a220-467e-8c58-cad2d8ccd183 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.280236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18d241-a220-467e-8c58-cad2d8ccd183 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.280236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18d241-a220-467e-8c58-cad2d8ccd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.300846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b18d241-a220-467e-8c58-cad2d8ccd183 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:48.301990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b18d241-a220-467e-8c58-cad2d8ccd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:48.311602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 801/1613] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:48.315175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.315175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.315175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.333666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 813/1614] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:48.335041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.335452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.335738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.338363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:48.340053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:48.348971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 802/1615] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:48.350513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.357584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:48.378146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] MFA Rules not processed for user `73a054a9f4ab46f9bc8d573236176b92`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:48.379515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:48.422562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb3ee5-1b17-4410-89d2-506fe31c7428 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.426277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.426884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.427490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.427490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.441469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.443667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.455712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 803/1616] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:48.456634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.469536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0643e-6263-4b13-8f81-d36435b97866 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.477931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 814/1617] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:48.477931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.480682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.489122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.489285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0cb2f-14b5-46a1-be45-c6812b4c4a0a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.490379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.491107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] PATH_INFO: `/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e/users/9e68168c8c794f2b9e3f32630e6ae729/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.494793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.495414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.495692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.496176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.509313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.511435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.521923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c08fa85b73469fbec4b77cbf6a235e, user_id=9e68168c8c794f2b9e3f32630e6ae729, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.524358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 815/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:48.526059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.528566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.540277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e0f72-0329-4236-ae86-fd9015c533b8 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.547207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.548088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.548856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.549422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.550220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.552583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.556853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 804/1619] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:48 2022] PUT /identity/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e/users/9e68168c8c794f2b9e3f32630e6ae729/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:48.560400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.603694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 816/1620] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:48.605452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.655691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:48.662880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8f55d-961e-4c34-a298-4e00e9b743db admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.725112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09074bc-e696-4d1b-a9b5-741b400a239e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.732769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.733855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.734428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.734842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.736078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.738517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.745464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.746151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.746555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.747990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.766003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.767556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.783581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 805/1621] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:48.783581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.785467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 817/1622] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:48.787250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.796690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1503b49-6fd3-4ed7-ab8f-bbe780debc0e service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.864308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:48.889538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec123bf2-ccc3-40ec-a334-7ec6ee235381 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.889999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.890596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.890927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.891964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.892910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.895267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.898821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.900894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.901477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.901908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.902757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.905134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.910383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 806/1623] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:48.911218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.925634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9222e9-b769-410e-a21b-c9b3cdcbea85 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.933670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.934548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.934836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.935109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.936161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:48.938406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:48.939160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 818/1624] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:48.940167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.966212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b55a35-66f5-4ff3-8da4-780910008522 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.978234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 807/1625] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:02:48 2022] POST /identity/v3/users => generated 299 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:02:48.981690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:48.990976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:48.992044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:48.992339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:48.992677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] PATH_INFO: `/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e/users/9e68168c8c794f2b9e3f32630e6ae729/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:48.999187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c97bb6-0d03-41e3-b510-116edabf6579 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:48.999383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c08fa85b73469fbec4b77cbf6a235e, user_id=9e68168c8c794f2b9e3f32630e6ae729, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.003035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.007846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.009076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.009679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.010209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.013545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.017273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.032722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 808/1626] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:49.034081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.044203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 819/1627] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:48 2022] PUT /identity/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e/users/9e68168c8c794f2b9e3f32630e6ae729/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:49.044596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.074254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb03d4-a7ed-49e1-96d3-b8ad76508fa5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.187719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de792898-e1a7-4b9d-a9dc-4d05f99485ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.203702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.204696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.204979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.205253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] PATH_INFO: `/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8/users/737fd864af364b73a11e1daf5300960d/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.234612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ee52b3945445f4b8fa870f341bb2d8, user_id=737fd864af364b73a11e1daf5300960d, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.244898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103fb79-430a-455e-85cb-1a1da0244cf7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.250717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.252053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.253403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.253829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.254574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.258563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.277441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 820/1628] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:49 2022] PUT /identity/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8/users/737fd864af364b73a11e1daf5300960d/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:49.277441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.277441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.278596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.291311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 809/1629] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:49.292201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.314535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881c8ff-8ae4-4b85-b7ff-4faaf95a682d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.328971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:49.343405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] MFA Rules not processed for user `9e68168c8c794f2b9e3f32630e6ae729`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:49.346286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:49.479601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.480326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.480715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.480988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.481677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.483249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.513458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 810/1630] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:49.513458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.532868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f6a0-23a0-43f9-9c0a-a1daa169538e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.541276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 821/1631] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:49.544425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.549567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.550240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.550524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.550800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] PATH_INFO: `/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba/users/e81e2a83ec2949a5ade63c96442a6882/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.569165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d26834-bd36-4b52-927d-b309e66ef0fd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.581481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6730a36a2a6845d59ebb2d72d9cb10ba, user_id=e81e2a83ec2949a5ade63c96442a6882, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.584078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.584628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.585533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.585930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.586310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] PATH_INFO: `/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8/users/737fd864af364b73a11e1daf5300960d/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.590619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ee52b3945445f4b8fa870f341bb2d8, user_id=737fd864af364b73a11e1daf5300960d, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.598413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.612825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 811/1632] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:49 2022] PUT /identity/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba/users/e81e2a83ec2949a5ade63c96442a6882/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:49.612825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.641514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 822/1633] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:49 2022] PUT /identity/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8/users/737fd864af364b73a11e1daf5300960d/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:49.641514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:49.660038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:49.743481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc006-40de-445d-b958-406c3612bf85 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.795496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb9d-0b63-4f0e-840d-ab84e78ac268 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:49.809254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.810019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.810312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.810588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.811589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:49.813340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21714-25aa-437b-8493-34f48da2aa63 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:49.840081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 823/1634] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:02:49.843563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.845230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.845581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.878013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:49.880809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:49.881100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:49.881385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:49.918938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] MFA Rules not processed for user `737fd864af364b73a11e1daf5300960d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:49.921023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:50.096464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:50.096464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e69a3-6464-4e2e-a27f-781f87571c6b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:50.099026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 824/1635] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:50.099026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:50.109385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 812/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:50.110793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6fee-dbaf-4343-bc57-135ad336dd73 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.111113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6fee-dbaf-4343-bc57-135ad336dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.111432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b6fee-dbaf-4343-bc57-135ad336dd73 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.112738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fbafb-8b93-4042-b818-30e821eeb7f8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:50.125058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 813/1637] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 10 17:02:50 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:02:50.126678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b6fee-dbaf-4343-bc57-135ad336dd73 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:50.129076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:50.129765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.130041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.130316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] PATH_INFO: `/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba/users/e81e2a83ec2949a5ade63c96442a6882/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.135285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6730a36a2a6845d59ebb2d72d9cb10ba, user_id=e81e2a83ec2949a5ade63c96442a6882, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:50.138137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644634d-b979-42e5-ab69-4fe56e8c5810 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:50.140585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:50.141766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b6fee-dbaf-4343-bc57-135ad336dd73 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:50.147126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:50.147879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.148366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.148763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.161878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 825/1638] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:02:50 2022] PUT /identity/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba/users/e81e2a83ec2949a5ade63c96442a6882/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:50.162509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:50.165213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.165559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.165682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1eb9ab-1f36-40bb-9aa2-72f57baad50e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:50.166189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.201460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 814/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:50.205049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151975c-18d2-4ad7-ba74-4bf13c1184b3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.206982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151975c-18d2-4ad7-ba74-4bf13c1184b3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.206982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151975c-18d2-4ad7-ba74-4bf13c1184b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.285267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:50.290232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:50.295667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9151975c-18d2-4ad7-ba74-4bf13c1184b3 None None] MFA Rules not processed for user `e81e2a83ec2949a5ade63c96442a6882`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:50.300272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9151975c-18d2-4ad7-ba74-4bf13c1184b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:50.417637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 826/1640] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 10 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:50.421491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:50.492939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:50.516050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 815/1641] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:50.519354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66713-cdfa-4a40-81a3-9e7854b72055 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.519636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66713-cdfa-4a40-81a3-9e7854b72055 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.519908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66713-cdfa-4a40-81a3-9e7854b72055 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.525078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 816/1642] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 10 17:02:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:02:50.526280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66713-cdfa-4a40-81a3-9e7854b72055 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:50.577244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aa931-475e-4a18-af16-9d0cded45ba5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:50.583111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:50.583884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.584169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.584437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.664982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66713-cdfa-4a40-81a3-9e7854b72055 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:50.676284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:50.677113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.677394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.678707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.686059 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:50.687831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6df26-b362-4215-95f5-a0be706afe4a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:50.714196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 827/1643] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:50.716400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:50.717150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:50.717862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:50.756864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:50.758847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:50.791126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 828/1644] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:50.859481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:50.861110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:50.878276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 817/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:51.168830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:51.172697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:51.193161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66dfd0-a105-4d3e-af1c-a401e20658a2 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:51.202047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de726938-0118-4d39-95c5-bf157a389b81 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:51.206278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:51.206917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:51.207199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:51.207469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:51.211582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:51.212212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:51.212602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:51.212825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:51.238430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:51.241043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:51.243325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8e34d-35b5-45ab-892a-871815428973 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:51.247417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:51.274666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 818/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:02:51.279600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 829/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:02:51.342561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:51.514603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc548c-6d35-47ee-a1a2-0ae1565bff9c service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:51.524293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:51.525013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:51.525261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:51.525541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] PATH_INFO: `/v3/users/73a054a9f4ab46f9bc8d573236176b92` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:51.526842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a054a9f4ab46f9bc8d573236176b92)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:51.528945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:51.600550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:51.618435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a054a9f4ab46f9bc8d573236176b92'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:51.633648 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a054a9f4ab46f9bc8d573236176b92'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:51.643825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a054a9f4ab46f9bc8d573236176b92'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:51.644872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a054a9f4ab46f9bc8d573236176b92'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:51.645689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a054a9f4ab46f9bc8d573236176b92'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:51.673729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 819/1648] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:02:51 2022] DELETE /identity/v3/users/73a054a9f4ab46f9bc8d573236176b92 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:02:51.675743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f782f-82c3-4925-a967-46b351f820ba None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:51.676192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f782f-82c3-4925-a967-46b351f820ba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:51.676292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f782f-82c3-4925-a967-46b351f820ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:51.720902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:51.745192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2f1f782f-82c3-4925-a967-46b351f820ba None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:51.746777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f1f782f-82c3-4925-a967-46b351f820ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:51.930286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 830/1649] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:52.048249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:52.050815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:52.267710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81d36-c7e8-41f6-9db3-509515934ff4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:52.278616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:52.280175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:52.280456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:52.284122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:52.336765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:52.341776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761ad7e-f99f-4ba0-b96d-cb52cc378fb4 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:52.394762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 820/1650] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:02:53.927204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290899-982a-4b19-bb49-ed784ebb41d6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:53.928058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290899-982a-4b19-bb49-ed784ebb41d6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:53.928509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70290899-982a-4b19-bb49-ed784ebb41d6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:53.930408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 831/1651] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 10 17:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:02:53.938243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16e19-6f40-41be-bb86-0a7012137fdd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:53.939151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16e19-6f40-41be-bb86-0a7012137fdd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:53.939708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f16e19-6f40-41be-bb86-0a7012137fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:53.971657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a1f16e19-6f40-41be-bb86-0a7012137fdd None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:53.973312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a1f16e19-6f40-41be-bb86-0a7012137fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:54.176445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 821/1652] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 10 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:54.177842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:54.178135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:54.179443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:54.181234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 832/1653] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 10 17:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:02:54.196450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:54.197123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:54.197743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:54.254463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:54.255879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:54.289216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 822/1654] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:02:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:54.289993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:54.291725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:54.464751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7ff9-d911-446f-9a07-e536010c8223 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:54.477016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:54.478938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:54.479524 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:54.479975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:54.498181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:54.499955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:54.515599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 833/1655] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:02:55.776281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:55.778634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:55.813183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98fbc6-921c-474a-9ab9-1ee77e873e59 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:55.826700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:55.827429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:55.827712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:55.828042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] PATH_INFO: `/v3/projects/fda4b8a82dc048e88b86b5dbc9a943ce` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:55.833216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda4b8a82dc048e88b86b5dbc9a943ce)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:55.834326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:55.834326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: warnings.warn(msg) Aug 10 17:02:55.834326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: Aug 10 17:02:55.836145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:55.902253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:55.920085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda4b8a82dc048e88b86b5dbc9a943ce', 'request_id': 'req-da995eb0-7407-4e26-90e8-c5aa5af0caac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:55.941607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda4b8a82dc048e88b86b5dbc9a943ce', 'request_id': 'req-da995eb0-7407-4e26-90e8-c5aa5af0caac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:55.992930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda4b8a82dc048e88b86b5dbc9a943ce', 'request_id': 'req-da995eb0-7407-4e26-90e8-c5aa5af0caac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.013981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] The token cache is being invalidate because project fda4b8a82dc048e88b86b5dbc9a943ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:02:56.014612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.016213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.020687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 823/1656] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:02:55 2022] DELETE /identity/v3/projects/fda4b8a82dc048e88b86b5dbc9a943ce => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:56.024207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:56.043633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282006-cdbf-4314-94c5-4985c63040db service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:56.234404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:56.235299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:56.236328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:56.237288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] PATH_INFO: `/v3/users/e81e2a83ec2949a5ade63c96442a6882` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:56.239493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81e2a83ec2949a5ade63c96442a6882)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:56.259965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 17:02:56.259965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: warnings.warn(msg) Aug 10 17:02:56.259965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: Aug 10 17:02:56.264309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:56.459074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81e2a83ec2949a5ade63c96442a6882'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.477663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:56.489290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81e2a83ec2949a5ade63c96442a6882'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.491403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81e2a83ec2949a5ade63c96442a6882'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.493371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81e2a83ec2949a5ade63c96442a6882'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.555017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-df303b00-ed05-43d1-ada6-9b18bbda67a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81e2a83ec2949a5ade63c96442a6882'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:56.615339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 834/1657] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:02:56 2022] DELETE /identity/v3/users/e81e2a83ec2949a5ade63c96442a6882 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:58.944742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:58.948097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:58.981568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da995eb0-7407-4e26-90e8-c5aa5af0caac admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:59.138983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:59.139460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:59.139530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:59.210771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:59.211489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:59.211893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:59.215265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] PATH_INFO: `/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:59.218882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6730a36a2a6845d59ebb2d72d9cb10ba)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:59.223735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:59.250160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] MFA Rules not processed for user `955e27b73d0f42698dcb99d7f3be3178`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:02:59.255261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:59.375104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6730a36a2a6845d59ebb2d72d9cb10ba', 'request_id': 'req-4a921249-77b2-491f-9eae-89f06a804e04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.404162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6730a36a2a6845d59ebb2d72d9cb10ba', 'request_id': 'req-4a921249-77b2-491f-9eae-89f06a804e04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.430757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6730a36a2a6845d59ebb2d72d9cb10ba', 'request_id': 'req-4a921249-77b2-491f-9eae-89f06a804e04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.487140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 835/1658] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:02:59.488378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:59.491539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:59.494097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] The token cache is being invalidate because project 6730a36a2a6845d59ebb2d72d9cb10ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:02:59.494395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.501445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.520343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 824/1659] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:02:58 2022] DELETE /identity/v3/projects/6730a36a2a6845d59ebb2d72d9cb10ba => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:59.520539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e369fe-ad93-452e-8bc2-3ceb2083f367 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:59.521373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:02:59.523944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:59.706392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:59.707553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:59.707833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:59.709913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] PATH_INFO: `/v3/users/c1240766f4a143a3ba2bcbdf35521959` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:59.712716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1240766f4a143a3ba2bcbdf35521959)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:02:59.717063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:02:59.718318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:59.794765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921249-77b2-491f-9eae-89f06a804e04 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:02:59.806060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:02:59.807495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:59.808608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:59.808939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:02:59.825428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:02:59.865752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1240766f4a143a3ba2bcbdf35521959'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.900287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1240766f4a143a3ba2bcbdf35521959'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.900977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1240766f4a143a3ba2bcbdf35521959'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.902054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1240766f4a143a3ba2bcbdf35521959'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.930352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:02:59.935440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63ac95bc-6df8-44fb-ab1c-9fdc42e2bc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1240766f4a143a3ba2bcbdf35521959'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:02:59.993336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 836/1660] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:02:59 2022] DELETE /identity/v3/users/c1240766f4a143a3ba2bcbdf35521959 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:02:59.994475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5a6d-736e-461b-bc68-5e48b1bace38 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:02:59.994759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5a6d-736e-461b-bc68-5e48b1bace38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:02:59.997675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e5a6d-736e-461b-bc68-5e48b1bace38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.007063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.008800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfec577-8178-4ca5-bf7c-20a3f570462d service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.037654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 825/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:00.039708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.040014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.040284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.052912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c87e5a6d-736e-461b-bc68-5e48b1bace38 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:00.054173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c87e5a6d-736e-461b-bc68-5e48b1bace38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:00.099906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:00.102113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:00.306527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 837/1662] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:00.308032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.308322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.308625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.321214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 826/1663] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:00.407715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:00.413374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:00.431509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.433717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:00.457188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 838/1664] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:00.460159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.481982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382670-a1dc-4715-9796-402e875ea490 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.493031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.496186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.496559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.496844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.497551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:00.499157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.502632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.545862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 839/1665] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:00.548681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.574585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208be29f-b347-4e87-89e8-06666b806d8a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.594282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.599607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.601739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351ca-8978-4180-880a-9b423b15dd98 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.601940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.602100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.605368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.610927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466892-facd-466c-8031-39223ef3f469 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.614436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.614906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.615286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.615677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.636273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.637952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.662552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 827/1666] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:00.690258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 840/1667] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:00 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:00.694615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.713884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb461c5b-36f3-4d2b-8e52-6fb7402d8001 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.722099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.722401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.722683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.785437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:00.806973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] MFA Rules not processed for user `508fe245e731449da94b0a7abf895f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:00.814117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:00.832979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.833779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.834165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.834542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.836303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.838468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.887264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 828/1668] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:00 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:00.890900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.910907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16639-b32c-41ba-9c76-53887da4a274 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.926434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.927330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.927726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.928099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.929472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:00.931978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:00.955165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 829/1669] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:00.959336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:00.983174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdeaa5-fdf2-4ed9-a5f2-7dd9a8db49a4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:00.993092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:00.994329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:00.994610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:00.994891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:00.997668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:01.003126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:01.022903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 841/1670] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:01.028958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 830/1671] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:01.044999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:01.063987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:01.068300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:01.087049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b90c5-56cb-4f59-a426-5ff972773b88 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:01.100205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:01.104773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:01.106228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:01.107347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] PATH_INFO: `/v3/projects/58bac4d6def643cb8222c3bd09ba8d37/users/2de072d39b8f41dfac44be65a7dbfc93/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:01.144971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bac4d6def643cb8222c3bd09ba8d37, user_id=2de072d39b8f41dfac44be65a7dbfc93, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:01.152947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502223ae-b353-46d4-9903-11f038d668d4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:01.200072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 842/1672] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:01 2022] PUT /identity/v3/projects/58bac4d6def643cb8222c3bd09ba8d37/users/2de072d39b8f41dfac44be65a7dbfc93/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:01.211603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:01.211983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:01.212337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:01.230159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:01.297251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6c54d-2d4c-4a9d-bb9d-eb3d97236272 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:01.297932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] MFA Rules not processed for user `2de072d39b8f41dfac44be65a7dbfc93`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:01.300471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:01.386032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:01.387093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:01.387501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:01.387911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:01.486115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 843/1673] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:01.490264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:01.505553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:01.564335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:01.570022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:01.617178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 831/1674] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:01.689257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199430-52ca-4946-b542-8af5dae1bd6e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:01.706275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:01.706911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:01.708070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:01.708410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:01.711801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:01.715956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:01.790250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 844/1675] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:01 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:01.793386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:01.820593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e5ea-6638-4f6b-9e25-1e52f0d38509 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.050223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.050866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.051254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.051645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.053408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.058121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.106459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 832/1676] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:01 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:02.107762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.133129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2424-5b24-498c-ad6b-17013a08f501 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.145955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.146640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.146989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.149700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.150518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.156148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.197323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 845/1677] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:02.199402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.219159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d51ce-25ea-4120-a6d0-4f69a2143acb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.240759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.243842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.245893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.246201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] PATH_INFO: `/v3/projects/5aa7368c83fc44e28f969c25184478f7/users/0c50d08f61674985b6f85ec80a1425fe/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.308699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa7368c83fc44e28f969c25184478f7, user_id=0c50d08f61674985b6f85ec80a1425fe, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.318380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.361399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 833/1678] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:02 2022] PUT /identity/v3/projects/5aa7368c83fc44e28f969c25184478f7/users/0c50d08f61674985b6f85ec80a1425fe/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:02.362678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.386498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44bb8a-8183-44ea-a09d-87e9d99ff725 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.517397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.518344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.518693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.518968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.523096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.527694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81566022-94c4-433e-82a1-d38d1f1f53a9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.557004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 846/1679] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:02.559221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.571824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf00a6a-f311-43f1-b509-e106453f8637 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.577570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.578589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.579055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.579794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] PATH_INFO: `/v3/projects/5aa7368c83fc44e28f969c25184478f7/users/0c50d08f61674985b6f85ec80a1425fe/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.582696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aa7368c83fc44e28f969c25184478f7, user_id=0c50d08f61674985b6f85ec80a1425fe, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.587593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.614029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 834/1680] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:02 2022] PUT /identity/v3/projects/5aa7368c83fc44e28f969c25184478f7/users/0c50d08f61674985b6f85ec80a1425fe/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:02.615576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.615868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.616977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.627725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.629766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:02.630247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:02.679212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] MFA Rules not processed for user `0c50d08f61674985b6f85ec80a1425fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:02.680988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:02.767362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3d4e8-8c00-4340-9015-577a881c07f6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:02.780961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:02.781637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:02.781908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:02.782184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] PATH_INFO: `/v3/projects/2b6e9e5dcd3448609044bfd81cf430e6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:02.783480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6e9e5dcd3448609044bfd81cf430e6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:02.785960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:02.861036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 847/1681] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:02.880265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:02.880582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:02.910543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:02.943285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6e9e5dcd3448609044bfd81cf430e6', 'request_id': 'req-33afe382-a6e8-4d66-9788-8727155cfd64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:02.963789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6e9e5dcd3448609044bfd81cf430e6', 'request_id': 'req-33afe382-a6e8-4d66-9788-8727155cfd64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.000886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6e9e5dcd3448609044bfd81cf430e6', 'request_id': 'req-33afe382-a6e8-4d66-9788-8727155cfd64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.020105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] The token cache is being invalidate because project 2b6e9e5dcd3448609044bfd81cf430e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:03.021322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.023056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.027043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 835/1682] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:02 2022] DELETE /identity/v3/projects/2b6e9e5dcd3448609044bfd81cf430e6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:03.030515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:03.040442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:03.045194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5711d-76e3-4c23-bf12-3082b52e7c4a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:03.192319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:03.193010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:03.193811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:03.194711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:03.197785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe382-a6e8-4d66-9788-8727155cfd64 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:03.201645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:03.217531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:03.218372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:03.218693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:03.219952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] PATH_INFO: `/v3/users/e624f5a4a24b489b839a56762853fb23` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:03.231397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e624f5a4a24b489b839a56762853fb23)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:03.237217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:03.359378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e624f5a4a24b489b839a56762853fb23'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.391966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e624f5a4a24b489b839a56762853fb23'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.396741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:03.411899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e624f5a4a24b489b839a56762853fb23'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.413813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e624f5a4a24b489b839a56762853fb23'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.416882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e624f5a4a24b489b839a56762853fb23'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.420204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:03.421720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a30314-5175-46f6-8b92-34b4ce547377 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:03.455877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 836/1683] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:03 2022] DELETE /identity/v3/users/e624f5a4a24b489b839a56762853fb23 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:03.457328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:03.459555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:03.460786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 848/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:03.466199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:03.466556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:03.466811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:03.541645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:03.542814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:03.622567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:03.704651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5864c-2fc4-40da-85ce-2d1239a2e540 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:03.732266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:03.735929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:03.737667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:03.738959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] PATH_INFO: `/v3/users/737fd864af364b73a11e1daf5300960d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:03.745265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737fd864af364b73a11e1daf5300960d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:03.755549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:03.807769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 849/1685] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:03.891229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737fd864af364b73a11e1daf5300960d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.912972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737fd864af364b73a11e1daf5300960d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.920124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:03.921740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:03.944135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737fd864af364b73a11e1daf5300960d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.947486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737fd864af364b73a11e1daf5300960d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.949509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737fd864af364b73a11e1daf5300960d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:03.986610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 837/1686] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:03 2022] DELETE /identity/v3/users/737fd864af364b73a11e1daf5300960d => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:04.086742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e5231-41ad-4800-a638-18a95c47e0b8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:04.240571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:04.242662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:04.243820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:04.244182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:04.248733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:04.393800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:04.395502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:04.466980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:04.471117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:04.497148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:04.510894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 850/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:04.608445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77085cae-44e1-438e-8ab3-af70ade2e1a1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:04.627440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c50d08f61674985b6f85ec80a1425fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa7368c83fc44e28f969c25184478f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:04.628081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:04.628373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:04.628681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:04.629356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:04.632350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:04.636982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:04.676726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 838/1688] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:04.682120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:04.699453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00412-9ddd-4b77-a5d9-df0c3aa20f58 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:04.708146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c50d08f61674985b6f85ec80a1425fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa7368c83fc44e28f969c25184478f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:04.708819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:04.709108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:04.709389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:04.710275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:04.712897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:04.768167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 851/1689] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:04 2022] POST /identity/v3/projects => generated 355 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:04.772656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:04.808043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c53950-4b9d-4f1a-becf-4933b14ac935 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:04.977899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:04.988827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c50d08f61674985b6f85ec80a1425fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa7368c83fc44e28f969c25184478f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:04.990023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:04.990715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:04.991610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:04.992619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:05.006269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:05.020644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e7c1-c992-4b4b-b1b8-b9d0c0229b78 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:05.052449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 839/1690] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:05.172410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:05.201896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d06b-af70-40de-8b12-313eb94dac55 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:05.220722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c50d08f61674985b6f85ec80a1425fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5aa7368c83fc44e28f969c25184478f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:05.221516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:05.221814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:05.222148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] PATH_INFO: `/v3/projects/d9c3a6f36ec742c080ba73eae7c69f37` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:05.233491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d9c3a6f36ec742c080ba73eae7c69f37)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:05.236024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:05.303237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436882-eccd-4619-a0b0-9ee55a315bc7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:05.304598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436882-eccd-4619-a0b0-9ee55a315bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:05.304892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436882-eccd-4619-a0b0-9ee55a315bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:05.371094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c3a6f36ec742c080ba73eae7c69f37', 'request_id': 'req-52173220-1d4d-42fc-89f8-bc8c2a48c568'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:05.379776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e4436882-eccd-4619-a0b0-9ee55a315bc7 None None] MFA Rules not processed for user `955e27b73d0f42698dcb99d7f3be3178`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:05.386357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4436882-eccd-4619-a0b0-9ee55a315bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:05.396387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c3a6f36ec742c080ba73eae7c69f37', 'request_id': 'req-52173220-1d4d-42fc-89f8-bc8c2a48c568'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:05.416735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c3a6f36ec742c080ba73eae7c69f37', 'request_id': 'req-52173220-1d4d-42fc-89f8-bc8c2a48c568'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:05.450697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] The token cache is being invalidate because project d9c3a6f36ec742c080ba73eae7c69f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:05.451004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:05.454784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:05.476517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 852/1691] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:05 2022] DELETE /identity/v3/projects/d9c3a6f36ec742c080ba73eae7c69f37 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:05.642443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 840/1692] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:06.104218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:06.111118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:06.305753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173220-1d4d-42fc-89f8-bc8c2a48c568 tempest-VolumeQuotaClassesTest-1168070981 tempest-VolumeQuotaClassesTest-1168070981-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:06.313888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:06.315150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:06.316413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:06.316751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] PATH_INFO: `/v3/users/2de072d39b8f41dfac44be65a7dbfc93` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:06.320773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de072d39b8f41dfac44be65a7dbfc93)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:06.323526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:06.416232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de072d39b8f41dfac44be65a7dbfc93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:06.433124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de072d39b8f41dfac44be65a7dbfc93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:06.435722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de072d39b8f41dfac44be65a7dbfc93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:06.437255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de072d39b8f41dfac44be65a7dbfc93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:06.458651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de072d39b8f41dfac44be65a7dbfc93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:06.460751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:06.546638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 853/1693] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:06 2022] DELETE /identity/v3/users/2de072d39b8f41dfac44be65a7dbfc93 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:06.551405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3ac2-ce33-4979-bde1-86af11d96112 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:06.551767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3ac2-ce33-4979-bde1-86af11d96112 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:06.552118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca3ac2-ce33-4979-bde1-86af11d96112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:06.599619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-55ca3ac2-ce33-4979-bde1-86af11d96112 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:06.602064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-55ca3ac2-ce33-4979-bde1-86af11d96112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:06.681634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 841/1694] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:06.719022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:06.720528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:06.885689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e10668-fc8c-47f1-af00-378029c0d78e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:06.890548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:06.891177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:06.891455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:06.891724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:06.912665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:06.915599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fd4fb-ea99-4a30-9021-24dc5684375b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:06.958724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 854/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:07.051772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:07.052399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:07.052848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:07.123548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] MFA Rules not processed for user `8f75312554114e81a2720c44ffc3ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:07.125335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:07.374291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 842/1696] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:07.392857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:07.393737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:07.394222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:07.440206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] MFA Rules not processed for user `8f75312554114e81a2720c44ffc3ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:07.448003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:07.487554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 855/1697] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:07.504187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:07.506010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:07.615100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:07.729581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df463-6cbd-400a-a47f-5b24bcc2d50f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:07.736876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:07.737604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:07.738290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:07.738681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:07.766041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:07.767755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741336f-7ba8-4f1a-bd14-ee667f6bdee1 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:07.792118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 843/1698] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:07 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:08.061637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:08.063491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.094879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899c968-cab2-4f00-af8a-f8651a1d8271 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:08.104259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:08.105249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.105716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.106193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] PATH_INFO: `/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.108732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ee52b3945445f4b8fa870f341bb2d8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:08.111796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:08.162196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2885-cafd-4858-b3d4-108ef00ef0d6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.162487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2885-cafd-4858-b3d4-108ef00ef0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.163331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2885-cafd-4858-b3d4-108ef00ef0d6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.165195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 844/1699] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 10 17:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 17:03:08.170808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.171862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.172154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.228146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ee52b3945445f4b8fa870f341bb2d8', 'request_id': 'req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.242228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ee52b3945445f4b8fa870f341bb2d8', 'request_id': 'req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.257206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ee52b3945445f4b8fa870f341bb2d8', 'request_id': 'req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.257858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.262096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.295804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] The token cache is being invalidate because project d3ee52b3945445f4b8fa870f341bb2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:08.295913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.298656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3ef904-8204-4b73-a7f6-873cfd7ccf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.299276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 856/1700] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:08 2022] DELETE /identity/v3/projects/d3ee52b3945445f4b8fa870f341bb2d8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:08.308004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.309283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.311160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.345321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.346730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.390219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 845/1701] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:08.391343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:08.393569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.416391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:08.465837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 857/1702] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:08.466737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:08.470533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.501052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c07519-a3a5-4f15-93fe-63c139458f4d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:08.515145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:08.516033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.516462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.517270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.528309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:08.543611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a8a3-ef9b-413b-847b-56c6ce7fa654 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:08.551936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63588dd4-00ad-4162-a585-64f867b00232 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:08.556572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 858/1703] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:08.558199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03490-1e6e-48eb-83cc-61b87f140449 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.558666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03490-1e6e-48eb-83cc-61b87f140449 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.559086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03490-1e6e-48eb-83cc-61b87f140449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.559754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:08.561354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.561638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.562080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] PATH_INFO: `/v3/projects/4a744dc709ba4b88a78ff0fc16c3d4eb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.565251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a744dc709ba4b88a78ff0fc16c3d4eb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:08.568351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:08.625148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-74c03490-1e6e-48eb-83cc-61b87f140449 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.626781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74c03490-1e6e-48eb-83cc-61b87f140449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.663801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:08.667975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a744dc709ba4b88a78ff0fc16c3d4eb', 'request_id': 'req-b51cdf57-5163-4a04-a898-7f462a99ee63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.689204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a744dc709ba4b88a78ff0fc16c3d4eb', 'request_id': 'req-b51cdf57-5163-4a04-a898-7f462a99ee63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.705423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a744dc709ba4b88a78ff0fc16c3d4eb', 'request_id': 'req-b51cdf57-5163-4a04-a898-7f462a99ee63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.736389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] The token cache is being invalidate because project 4a744dc709ba4b88a78ff0fc16c3d4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:08.737068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.737391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b51cdf57-5163-4a04-a898-7f462a99ee63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:08.739173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 846/1704] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:08 2022] DELETE /identity/v3/projects/4a744dc709ba4b88a78ff0fc16c3d4eb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:08.746076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9721-df80-42d8-b408-2c113b08cf81 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.746380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9721-df80-42d8-b408-2c113b08cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.746664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d9721-df80-42d8-b408-2c113b08cf81 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.749059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 847/1705] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 10 17:03:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:03:08.750359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.750646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.751000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.790048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.795710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.804251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 859/1706] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:08.808588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b9c2-b694-47dc-a8e0-73f90ef24bda None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.808881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b9c2-b694-47dc-a8e0-73f90ef24bda None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.809160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338b9c2-b694-47dc-a8e0-73f90ef24bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.825751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 848/1707] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:08.827069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:08.851850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d00123-108e-432d-ada8-dc3063f4c498 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:08.863348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5338b9c2-b694-47dc-a8e0-73f90ef24bda None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.869600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:08.870257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.870544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.870935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.871480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:08.871783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:08.873456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecaa7e-f5aa-432a-9635-f93cfd5ee42f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:08.878387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5338b9c2-b694-47dc-a8e0-73f90ef24bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:08.919923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 849/1708] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:08.919923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:08.919923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:08.919923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:08.973109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:08.974451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.010875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 850/1709] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:09.011488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.018300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 860/1710] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:03:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:09.019960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.020912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.021341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.043818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76990837-6a41-4471-acbf-bc92663e3b74 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.056162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.057713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.058007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.058637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.058934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.061379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d7438-5497-448c-9549-a4de5cf937d3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.065341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] MFA Rules not processed for user `508fe245e731449da94b0a7abf895f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:09.066586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.104681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 851/1711] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:09.108708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.108993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.109268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.167722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 861/1712] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:09.168921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.173945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.178526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] MFA Rules not processed for user `293351869c8f45688bb70ffc1e812485`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:09.180239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.202731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87d32-0f48-47a5-bb84-5ddb0b8684a7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.278077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 852/1713] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:09.281717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.287639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:09.331068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.331819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.332179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.332599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] PATH_INFO: `/v3/projects/58bac4d6def643cb8222c3bd09ba8d37` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.334372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bac4d6def643cb8222c3bd09ba8d37)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.336786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.413539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07479b2f-e87e-4a35-b38c-05bf19c6881c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.439446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bac4d6def643cb8222c3bd09ba8d37', 'request_id': 'req-597cc894-12b3-4a30-b610-a64e6ba8c88e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.451265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bac4d6def643cb8222c3bd09ba8d37', 'request_id': 'req-597cc894-12b3-4a30-b610-a64e6ba8c88e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.476747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bac4d6def643cb8222c3bd09ba8d37', 'request_id': 'req-597cc894-12b3-4a30-b610-a64e6ba8c88e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.483558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:09.509800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] The token cache is being invalidate because project 58bac4d6def643cb8222c3bd09ba8d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:09.510105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.512286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.516824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 862/1714] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:09 2022] DELETE /identity/v3/projects/58bac4d6def643cb8222c3bd09ba8d37 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:09.516824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.517330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.577040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.577658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.577940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.578211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.578875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:09.579603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.581392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.611387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc894-12b3-4a30-b610-a64e6ba8c88e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.616971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.617753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 853/1715] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:09.619299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.622120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.622519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.622902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.625071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.625367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.641182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.644082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6e133-5037-4801-a8ba-2ef5e91a86d5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.647946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302f89-5c78-4a3d-ab08-d3614a50e34a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.658584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.659236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.659535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.659975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 863/1716] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:09.661457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.661860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.662268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.677453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.680592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.682599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a62d4c-b02c-495c-8f5c-77db394db0f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.688084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] MFA Rules not processed for user `293351869c8f45688bb70ffc1e812485`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:09.689616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.737410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 854/1717] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:09.742530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.742823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.743104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.752265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 855/1718] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 10 17:03:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:03:09.753259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.758483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.770490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 864/1719] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:09.771515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.773410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:09.795930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dab70a-03dc-4572-82f8-845496912d3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.811568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946a9ee-f7dc-400e-923b-e07e498b93e9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:09.813223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.814548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.815205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.816031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] PATH_INFO: `/v3/users/0c50d08f61674985b6f85ec80a1425fe` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.818215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c50d08f61674985b6f85ec80a1425fe)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.822593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:09.823555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:09.823984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.824339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:09.826300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:09.827066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:09.831400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:09.876516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:09.893486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 865/1720] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:09 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:09.895018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:09.919984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c50d08f61674985b6f85ec80a1425fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.946054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c50d08f61674985b6f85ec80a1425fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.996684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c50d08f61674985b6f85ec80a1425fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.997585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c50d08f61674985b6f85ec80a1425fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:09.998429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1d59fb5f-26ba-4883-a496-12e66db224ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c50d08f61674985b6f85ec80a1425fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:10.017206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 856/1721] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:09 2022] DELETE /identity/v3/users/0c50d08f61674985b6f85ec80a1425fe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:10.019623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.019623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.019922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.046106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:10.047352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.089145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861225a5-dd2f-4f6f-9ca0-7174d51764eb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.180592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.181231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.181669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.182257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.184098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.186905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.199752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 866/1722] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:10.200730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.205090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.210767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 857/1723] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 10 17:03:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:10.211844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.213480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.226667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48118f-718d-48f6-a152-e4ce52815f6c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.232030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.233513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.233865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.234248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.235091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.238133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.245728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4469-ae9f-466f-a844-b40585e4ae70 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.261125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.263736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.263736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.263736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.264176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.266829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.270518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:10.294200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 867/1724] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:10 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:10.295572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.297855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 858/1725] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:10.300758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.331057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aca08-5bcb-4e05-859d-66f327e23831 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.332808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef861a-da0d-41f6-bdee-7b3ae25b516f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.339083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.340230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.340923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.341344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.343575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.349656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.350446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.350828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.351133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] PATH_INFO: `/v3/projects/44e348ce78bd4df0afae251ff9eaaff1/users/1f82b85146934e8daf37a8eb2f3428d7/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.362935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.366048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.388628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e348ce78bd4df0afae251ff9eaaff1, user_id=1f82b85146934e8daf37a8eb2f3428d7, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.391500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f532a-fa4b-48ba-9ce1-33815d8c7d0f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.391943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 868/1726] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:10.395492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.410906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 859/1727] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:10 2022] PUT /identity/v3/projects/44e348ce78bd4df0afae251ff9eaaff1/users/1f82b85146934e8daf37a8eb2f3428d7/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:10.424592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.424884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.427526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.428270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5447d1-4cd4-4b49-8651-e909810f9fb5 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.575143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] MFA Rules not processed for user `1f82b85146934e8daf37a8eb2f3428d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:10.581870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.635029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.635787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.635992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.636276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.636990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.638706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.662579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 869/1728] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:10.662579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.666772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.690793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:10.872312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 860/1729] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:10.872312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:10.905443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e175cfe-a428-4158-8aa3-cc153ec64994 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.917197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.917985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.918349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.918541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.919203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:10.921078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:10.927783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b6dd-d035-4718-b8e9-4ea7d039151d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:10.944746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:10.945398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:10.945682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:10.945958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:10.958244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:10.960227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 861/1730] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:10.961192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:11.017741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6e7ae-7e31-4a86-9b84-db960ca29db1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:11.044790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:11.045421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.045703 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.045976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.049384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:11.056346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:11.104709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:11.106384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:11.137505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 870/1731] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:11.138113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:11.152272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ecf27-f2ee-409c-88c5-cee8edade14e service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:11.185279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:11.186225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.186696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.187775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] PATH_INFO: `/v3/projects/647e7d9c4d1f47738f0ea7399f4a515e/users/22e16ff6223143bc9a3ac1d807712be5/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.229311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 862/1732] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:10 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:11.233185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:11.277149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647e7d9c4d1f47738f0ea7399f4a515e, user_id=22e16ff6223143bc9a3ac1d807712be5, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:11.293163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757913c5-03a6-40f7-9ec6-f05a92770855 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:11.386821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 871/1733] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:11 2022] PUT /identity/v3/projects/647e7d9c4d1f47738f0ea7399f4a515e/users/22e16ff6223143bc9a3ac1d807712be5/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:11.398999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3529-424b-411d-81d8-eba093ef514a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.399330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3529-424b-411d-81d8-eba093ef514a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.402191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac3529-424b-411d-81d8-eba093ef514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.509840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-51ac3529-424b-411d-81d8-eba093ef514a None None] MFA Rules not processed for user `22e16ff6223143bc9a3ac1d807712be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:11.515805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51ac3529-424b-411d-81d8-eba093ef514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:11.543750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c0ac-a33e-4600-92bb-4c2b0a273dda admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:11.675901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:11.763971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 872/1734] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:11.769320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.769419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.774580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.782337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:11.783189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.785457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.786066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.787000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:11.791421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:11.842507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 863/1735] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:11 2022] POST /identity/v3/users => generated 294 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:11.849525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:11.850660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] MFA Rules not processed for user `8f75312554114e81a2720c44ffc3ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:11.856503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:11.866467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:11.894278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301a91-ce6e-4ba4-8da0-2c8c3278645d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:11.908055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:11.910200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:11.922157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:11.926034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:11.927254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:11.938765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:12.042830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 864/1736] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:11 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:12.046521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:12.104663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 873/1737] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:12.111360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:12.119109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:12.178197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0aec7a-9b9b-49b8-aca7-c331f5f6f6cf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:12.336649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac82968-46b4-4c09-bb0f-1dc127723454 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:12.361306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:12.362039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.362214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.362488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.363147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:12.376674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:12.379602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:12.380551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.380843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.381142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] PATH_INFO: `/v3/projects/5aa7368c83fc44e28f969c25184478f7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.390277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aa7368c83fc44e28f969c25184478f7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:12.412758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:12.440220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 865/1738] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:12.440220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:12.473339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a84c6-0d42-4722-b901-c5e60b08084f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:12.495572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:12.496528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.496688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.497032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.498601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:12.505016 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:12.615477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 866/1739] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:12 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:12.621671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:12.625651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aa7368c83fc44e28f969c25184478f7', 'request_id': 'req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:12.642073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aa7368c83fc44e28f969c25184478f7', 'request_id': 'req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:12.656299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aa7368c83fc44e28f969c25184478f7', 'request_id': 'req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:12.673845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7327a9-bd4e-40bc-a3fe-0ab9cbc51b53 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:12.676035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] The token cache is being invalidate because project 5aa7368c83fc44e28f969c25184478f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:12.676343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:12.677077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:12.681034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 874/1740] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:12 2022] DELETE /identity/v3/projects/5aa7368c83fc44e28f969c25184478f7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:12.682838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:12.690471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:12.858529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:12.873252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:12.874172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.874462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.874942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] PATH_INFO: `/v3/projects/32e244d2635e42529f126ad4499096ee/users/ed60d485d90641e6861ffe704bdcc677/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.922008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e244d2635e42529f126ad4499096ee, user_id=ed60d485d90641e6861ffe704bdcc677, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:12.930993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54aa20-e583-49ce-99ab-b09fc65fd6b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:12.943107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ef7e-cee9-460b-9a6f-8b36d0ff42b8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:12.961766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 867/1741] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:12 2022] PUT /identity/v3/projects/32e244d2635e42529f126ad4499096ee/users/ed60d485d90641e6861ffe704bdcc677/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:12.965362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.965740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.966033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.966367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:12.967011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:12.967292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:12.967567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:12.968223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:12.969878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.007942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 875/1742] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:13.009928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:13.021936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:13.028973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:13.049027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9c-7137-4e71-9c39-97d726746e2d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:13.058182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:13.060371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:13.204027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:13.206111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.207686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.208111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.210815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:13.217249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.253320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 876/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:13.254396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:13.278676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8a62-7c48-4b31-808a-67137390910c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:13.291091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:13.291967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.292390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.292836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] PATH_INFO: `/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a/users/e38bb1f63b104a6c837137c1ea18ed6c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.333547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1049dfa0a11a4b79b9814f2965b3e06a, user_id=e38bb1f63b104a6c837137c1ea18ed6c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:13.350664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e72bd8-2c4f-4ea4-9b3d-a91cae4dd979 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.366053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 868/1744] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:13.368981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:13.382957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 877/1745] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:13 2022] PUT /identity/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a/users/e38bb1f63b104a6c837137c1ea18ed6c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:13.384781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7de19-969d-4dde-866b-87f3a452f912 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.385293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7de19-969d-4dde-866b-87f3a452f912 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.385806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7de19-969d-4dde-866b-87f3a452f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.402793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bf4c0-e515-4182-8ad0-86491d1d765f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:13.480846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3dc7de19-969d-4dde-866b-87f3a452f912 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:13.482346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3dc7de19-969d-4dde-866b-87f3a452f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:13.570853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:13.571695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.572158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.572621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] PATH_INFO: `/v3/projects/32e244d2635e42529f126ad4499096ee/users/ed60d485d90641e6861ffe704bdcc677/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.583759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e244d2635e42529f126ad4499096ee, user_id=ed60d485d90641e6861ffe704bdcc677, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:13.586733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.633951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 869/1746] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:13 2022] PUT /identity/v3/projects/32e244d2635e42529f126ad4499096ee/users/ed60d485d90641e6861ffe704bdcc677/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:13.642652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:13.672781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 878/1747] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:13.674503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.674913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.675303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.783882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] MFA Rules not processed for user `ed60d485d90641e6861ffe704bdcc677`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:13.785132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:13.830371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f9e42-30aa-4ba9-ab2e-39d451b7796d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:13.848128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:13.849430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.850910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.851496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.852677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:13.854573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.881071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 870/1748] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:13.883189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:13.905939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7231-283e-42bf-bf2f-aa129f13af44 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:13.917543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:13.918789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:13.920223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:13.920622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:13.946788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:13.948897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:13.955211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:13.962231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:13.989651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 871/1749] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:13.990739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:14.017744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2356bef-de75-4958-8fb9-406beb4c6743 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:14.047962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:14.050797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.051089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.052676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] PATH_INFO: `/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a/users/e38bb1f63b104a6c837137c1ea18ed6c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.058266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1049dfa0a11a4b79b9814f2965b3e06a, user_id=e38bb1f63b104a6c837137c1ea18ed6c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:14.066571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745242-e4a7-406b-bf25-51cacc9d67f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:14.086938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 879/1750] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:14.088051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:14.096876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 872/1751] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:13 2022] PUT /identity/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a/users/e38bb1f63b104a6c837137c1ea18ed6c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:14.112942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.123955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.124593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.144093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b4a-9228-4f18-91c1-d960332c5c51 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:14.189623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:14.213811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] MFA Rules not processed for user `e38bb1f63b104a6c837137c1ea18ed6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:14.223042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:14.372116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:14.372769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.375736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.376053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.380504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:14.386936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:14.423372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 873/1752] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:14.425773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:14.440454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:14.476854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 880/1753] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:14 2022] POST /identity/v3/projects => generated 393 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:14.479589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:14.491654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:14.616702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c93429-cef8-406f-b018-f9580033cbf0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:14.625262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:14.627338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.628734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.629188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.630322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026bbaa-bcd9-4ec8-b944-4c741335a3d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:14.633953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:14.636459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:14.637603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.638393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.638967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.643118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:14.763454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:14.766079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:14.779991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 881/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:14.781809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:14.821724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:14.830958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:14.832421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:14.869212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 874/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:14.962196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6351e6-4a5b-47a7-ba8e-4202ee1356ee service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:14.977170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:14.981051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:14.982015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:14.984417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:14.985267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:14.992154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:15.056048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 882/1756] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:14 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:15.057276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:15.078153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b060154-7a10-418c-86df-ab97fcb5c9fa service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:15.097497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:15.104094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:15.107595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:15.107900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:15.109669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:15.116571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:15.158572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 875/1757] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:15.164113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:15.180870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e812d-9558-4c40-9fc7-fc94ad86017b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:15.212281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:15.215310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:15.215596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:15.215871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:15.216652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:15.226771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07616b-1dc7-4e54-9298-2c887b0f5883 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:15.253685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 883/1758] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:15.258107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:15.281903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0dc23-576b-4ad3-ae7d-19f70a8095c1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:15.301015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:15.301762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:15.304518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:15.304518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] PATH_INFO: `/v3/projects/687fe4c7c6b34517a23cbbc5ac0e3c09/users/a9909a5629104200a23f300ac7303e80/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:15.418678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] RBAC: Authorizing `identity:create_grant(project_id=687fe4c7c6b34517a23cbbc5ac0e3c09, user_id=a9909a5629104200a23f300ac7303e80, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:15.425930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:15.492112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 876/1759] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:15 2022] PUT /identity/v3/projects/687fe4c7c6b34517a23cbbc5ac0e3c09/users/a9909a5629104200a23f300ac7303e80/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:15.492423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:15.493043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:15.493570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:15.609738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] MFA Rules not processed for user `a9909a5629104200a23f300ac7303e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:15.617162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:15.943045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 884/1760] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:15.944577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.068092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:16.185357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026aaa4-33d0-45a6-b92e-5133bbaa21db admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.194231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.208512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.208978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.214821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:16.215774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:16.218615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:16.308781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 877/1761] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:15 2022] POST /identity/v3/projects => generated 393 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:16.312949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.328108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2ea34-af2e-4bde-8fb4-b4d23431c2b8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.480822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.482234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.482700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.483181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:16.484046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:16.486900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:16.541358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 885/1762] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:16 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:16.543433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.561460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb57f93-a4a4-45b3-b9a6-36e070609ffe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.566840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.567586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.568022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.568297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:16.570213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:16.573024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:16.594519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 878/1763] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:16.594709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.623037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a850a-88f7-4ad4-acde-73a9c05c3876 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.632694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.633751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.634200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.634604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] PATH_INFO: `/v3/projects/09ea8ffbc320468d9b2108101c643d61/users/2bdff643296d49068cc3a7b6e17ca6c3/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:16.657983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:16.662556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ea8ffbc320468d9b2108101c643d61, user_id=2bdff643296d49068cc3a7b6e17ca6c3, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:16.666915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:16.695961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 886/1764] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:16 2022] PUT /identity/v3/projects/09ea8ffbc320468d9b2108101c643d61/users/2bdff643296d49068cc3a7b6e17ca6c3/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:16.701473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.715600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ac1e-b4d3-473d-82fa-16074b436be2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.867879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.871642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.872174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.872775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:16.873808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:16.880532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75015c7d-4523-4a95-a621-3b6f3d311d84 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:16.923981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 879/1765] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:16.928718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:16.949440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4297-bdb1-4a85-9ac7-feca31b1ec38 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:16.982410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:16.983090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.985169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:16.985455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:16.986329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:17.001153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:17.003961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] PATH_INFO: `/v3/projects/09ea8ffbc320468d9b2108101c643d61/users/2bdff643296d49068cc3a7b6e17ca6c3/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:17.019874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ea8ffbc320468d9b2108101c643d61, user_id=2bdff643296d49068cc3a7b6e17ca6c3, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:17.035509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61fb7-8150-41e2-8728-39080e38437a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:17.111345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 887/1766] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:16 2022] PUT /identity/v3/projects/09ea8ffbc320468d9b2108101c643d61/users/2bdff643296d49068cc3a7b6e17ca6c3/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:17.128594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:17.133094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:17.137270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:17.241512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] MFA Rules not processed for user `2bdff643296d49068cc3a7b6e17ca6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:17.243383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:17.247929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:17.254447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:17.464370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 888/1767] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:17.465480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:17.474555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 880/1768] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:17.867883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:17.882856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:17.933178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:18.065903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c237755-f95a-49b5-9b64-660c9d7cba70 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:18.073848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62638913-0ec5-4722-bfd7-4c492653c5a6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:18.083492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:18.083492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:18.083492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:18.083492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:18.086449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:18.087397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:18.087809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:18.088087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:18.108782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:18.110165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:18.111911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:18.113847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200085f4-24a5-414a-8a65-c7459e077718 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:18.126731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 889/1769] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:03:18.142435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 881/1770] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:18.567759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:18.589709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa62e2-92fd-4272-80cd-8d852a49b715 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:18.605706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:18.606492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:18.606775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:18.607046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:18.694166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:18.695202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:18.695623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:18.738612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:18.740012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:18.858122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:18.937049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 882/1771] 10.222.0.13 () {58 vars in 1015 bytes} [Wed Aug 10 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:18.940520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:18.958803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:18.966483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:18.987489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7194cb-ed36-498d-8fe9-20f75e629cd2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:18.999863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:19.000505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:19.000785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:19.001062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:19.016048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 890/1772] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:19.019355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:19.023722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:19.072268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce36717-aa86-402d-b3a5-ca605e4fe3ac service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:19.083159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:19.083672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:19.083911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:19.089131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:19.113502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:19.118642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:19.154553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 891/1773] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:19.291374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:19.298420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0cded-f93e-4b55-b4ff-16b9528ad856 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:19.339389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 883/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:22.188245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:22.201479 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9198f-ae38-4797-b4e3-e9cfe70c13e1 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:22.210408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:22.214496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:22.215234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:22.216025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:22.248844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2480-3a39-4133-ab58-f6ea26dbc761 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:22.248844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2480-3a39-4133-ab58-f6ea26dbc761 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:22.248844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c2480-3a39-4133-ab58-f6ea26dbc761 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:22.248844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 884/1775] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:03:22.365046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:22.366222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:22.366510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:22.398929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:22.400994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:22.410570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:22.420665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:22.431681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 892/1776] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:22.556092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:22.684246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 885/1777] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:03:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:23.563696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:23.565854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:23.609563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cfbb0-9f7d-4c15-85a2-cd1c380800cb service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:23.631591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:23.634227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:23.636742 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:23.637405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:23.679640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:23.682586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3866c-9ca6-4cbb-8fea-ce172418496b service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:23.701573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 893/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:25.845702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:26.064981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6b2c7-0af1-4304-9dab-3ef3ce41836c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:26.083706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:26.086203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:26.086966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:26.087918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] PATH_INFO: `/v3/users/a9909a5629104200a23f300ac7303e80` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:26.090540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9909a5629104200a23f300ac7303e80)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:26.093210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:26.248531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9909a5629104200a23f300ac7303e80'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:26.318046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9909a5629104200a23f300ac7303e80'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:26.347894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9909a5629104200a23f300ac7303e80'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:26.350620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9909a5629104200a23f300ac7303e80'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:26.353607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9909a5629104200a23f300ac7303e80'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:26.416657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 886/1779] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:25 2022] DELETE /identity/v3/users/a9909a5629104200a23f300ac7303e80 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:26.421542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8589e9-ccb0-438d-877c-06d31395eb6a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:26.422209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8589e9-ccb0-438d-877c-06d31395eb6a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:26.422320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8589e9-ccb0-438d-877c-06d31395eb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:26.494058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8f8589e9-ccb0-438d-877c-06d31395eb6a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:26.500268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f8589e9-ccb0-438d-877c-06d31395eb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:26.648289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 894/1780] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:26.705852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:26.707120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:26.853452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ca2b0-0db8-4074-9f63-5a6a167cbd62 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:26.874402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:26.875210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:26.876941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:26.876941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:26.904883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:26.904883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721bbe2-2903-4bd5-8aca-bcc578311597 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:26.908041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:26.917635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 887/1781] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:27.320874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:27.321391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:27.322489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:27.328368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 895/1782] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:03:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:03:27.391190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:27.391470 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:27.391915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:27.498914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:27.507803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:27.668792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 888/1783] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:03:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:27.918607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:27.920692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:27.941620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:27.953316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:27.981457 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d6d4b-becb-4d24-935c-99d263d59036 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:27.992591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02c56e-136d-48d2-ae8c-70d15105817f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:28.001124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:28.002508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:28.013830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:28.014888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] PATH_INFO: `/v3/projects/687fe4c7c6b34517a23cbbc5ac0e3c09` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:28.016202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:28.017708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687fe4c7c6b34517a23cbbc5ac0e3c09)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:28.018043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:28.018480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:28.018890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:28.021771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:28.046073 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:28.047747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:28.089222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 889/1784] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:28.124242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:28.149400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687fe4c7c6b34517a23cbbc5ac0e3c09', 'request_id': 'req-f9ddad4a-cae1-45a2-ac0f-3695919ff050'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.171495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687fe4c7c6b34517a23cbbc5ac0e3c09', 'request_id': 'req-f9ddad4a-cae1-45a2-ac0f-3695919ff050'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.207249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687fe4c7c6b34517a23cbbc5ac0e3c09', 'request_id': 'req-f9ddad4a-cae1-45a2-ac0f-3695919ff050'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.275993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] The token cache is being invalidate because project 687fe4c7c6b34517a23cbbc5ac0e3c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:28.276295 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.277268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.278840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 896/1785] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:27 2022] DELETE /identity/v3/projects/687fe4c7c6b34517a23cbbc5ac0e3c09 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:28.286225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:28.313982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b495af-9f1a-4e8b-9dae-65159e75d327 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:28.518604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:28.519697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:28.520292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:28.520812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] PATH_INFO: `/v3/users/2bdff643296d49068cc3a7b6e17ca6c3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:28.524275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdff643296d49068cc3a7b6e17ca6c3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:28.529176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:28.641120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdff643296d49068cc3a7b6e17ca6c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.680197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdff643296d49068cc3a7b6e17ca6c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.706818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdff643296d49068cc3a7b6e17ca6c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.708563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdff643296d49068cc3a7b6e17ca6c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.710022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdff643296d49068cc3a7b6e17ca6c3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:28.714612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:28.734914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 890/1786] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:28 2022] DELETE /identity/v3/users/2bdff643296d49068cc3a7b6e17ca6c3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:29.260006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:29.261691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:29.281162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddad4a-cae1-45a2-ac0f-3695919ff050 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:29.398025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:29.399075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:29.399375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:29.399720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] PATH_INFO: `/v3/users/22e16ff6223143bc9a3ac1d807712be5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:29.401120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e16ff6223143bc9a3ac1d807712be5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:29.405095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:29.540677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:29.542778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:29.570169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf590-d8a1-4e62-b55d-68aa22571dad admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:29.590250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e16ff6223143bc9a3ac1d807712be5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.596435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:29.597364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:29.599229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:29.600265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] PATH_INFO: `/v3/projects/09ea8ffbc320468d9b2108101c643d61` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:29.603038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ea8ffbc320468d9b2108101c643d61)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:29.607339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:29.610200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e16ff6223143bc9a3ac1d807712be5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.611442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e16ff6223143bc9a3ac1d807712be5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.612610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e16ff6223143bc9a3ac1d807712be5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.641275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-637f1ee8-c848-43b8-aede-1be2799b8ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e16ff6223143bc9a3ac1d807712be5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.685229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 897/1787] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:29 2022] DELETE /identity/v3/users/22e16ff6223143bc9a3ac1d807712be5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:29.689782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:29.690262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:29.690711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:29.744426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ea8ffbc320468d9b2108101c643d61', 'request_id': 'req-9a7fd1bf-1b96-42bf-9144-2634802421f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.746388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:29.748800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:29.761178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ea8ffbc320468d9b2108101c643d61', 'request_id': 'req-9a7fd1bf-1b96-42bf-9144-2634802421f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.772910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ea8ffbc320468d9b2108101c643d61', 'request_id': 'req-9a7fd1bf-1b96-42bf-9144-2634802421f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.797845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] The token cache is being invalidate because project 09ea8ffbc320468d9b2108101c643d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:29.799723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.801889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9a7fd1bf-1b96-42bf-9144-2634802421f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:29.806763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 891/1788] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:29 2022] DELETE /identity/v3/projects/09ea8ffbc320468d9b2108101c643d61 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:29.811619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3c6a-e0b5-4399-8631-9bfc8a3b0eab None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:29.812641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3c6a-e0b5-4399-8631-9bfc8a3b0eab None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:29.813389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3c6a-e0b5-4399-8631-9bfc8a3b0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:29.867519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:29.870407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f24e3c6a-e0b5-4399-8631-9bfc8a3b0eab None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:29.872262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f24e3c6a-e0b5-4399-8631-9bfc8a3b0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:29.962315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 898/1789] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:29.969483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:29.982339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:30.005219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 892/1790] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:30.014559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.015074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.017071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.079845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:30.084761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:30.112825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 893/1791] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:30.115032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.139902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6fa98-1a95-4441-ab24-6bfb2936e107 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.157751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a7c88-1979-4b03-a03c-56e49859614a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.159103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.160997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.160997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.160997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.161551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:30.162084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.164558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.165190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.165849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.166534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.167051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.216023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.221936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.230045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 894/1792] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:30.238691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.243837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 899/1793] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:30.255222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f749b6-3be2-4358-9fd2-234b2005607f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.261094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.262142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.262430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.262760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.268319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.270586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.325392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.331492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 895/1794] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:30 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:30.338105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402057e-c7ae-4a44-825c-3b006fee49d1 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.544823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.545549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.545957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.546543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.547207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.549654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.593773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 900/1795] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:30 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:30.598281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.612080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33995b-9fb9-4eb3-9268-8c0311c3bf84 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.630381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.632011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.632364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.632732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.633502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.635387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.649520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 896/1796] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:30.653920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.666807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd374254-fdfd-4d54-b8f6-f6ac7c5e3f9f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.672343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.673092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.673490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.673834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.674584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.676256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798e13-186f-40fb-8819-03e60f0a7f20 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.690376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 901/1797] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:30.691774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.706706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2524f36-2e60-48e4-bbe1-a4569d3772d6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.713671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.714345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.714861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.715520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] PATH_INFO: `/v3/projects/50b9b73ac796410f8b6578b47c4e5579/users/e24213246b8b4986a71c877e1dd93516/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.734745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b9b73ac796410f8b6578b47c4e5579, user_id=e24213246b8b4986a71c877e1dd93516, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:30.737880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:30.784088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 897/1798] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:30 2022] PUT /identity/v3/projects/50b9b73ac796410f8b6578b47c4e5579/users/e24213246b8b4986a71c877e1dd93516/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:30.785058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadd97-2235-4383-844b-371582c1b9ae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.785461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadd97-2235-4383-844b-371582c1b9ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.785810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadd97-2235-4383-844b-371582c1b9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:30.824575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-accadd97-2235-4383-844b-371582c1b9ae None None] MFA Rules not processed for user `e24213246b8b4986a71c877e1dd93516`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:30.825897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-accadd97-2235-4383-844b-371582c1b9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:30.857484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.862091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:30.872144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:30.945856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:30.961383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 902/1799] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:30.967105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadd97-2235-4383-844b-371582c1b9ae None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:30.990725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399338a-b721-492a-aecf-0b0df9c6c7f0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:30.996835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:30.997716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:30.998067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:30.999114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] PATH_INFO: `/v3/projects/647e7d9c4d1f47738f0ea7399f4a515e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.001518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647e7d9c4d1f47738f0ea7399f4a515e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.004597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.064667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadd97-2235-4383-844b-371582c1b9ae None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.080825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647e7d9c4d1f47738f0ea7399f4a515e', 'request_id': 'req-8e8738cd-41a2-48c6-b843-e4ce8b197b00'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.088891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647e7d9c4d1f47738f0ea7399f4a515e', 'request_id': 'req-8e8738cd-41a2-48c6-b843-e4ce8b197b00'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.095366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647e7d9c4d1f47738f0ea7399f4a515e', 'request_id': 'req-8e8738cd-41a2-48c6-b843-e4ce8b197b00'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.113577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] The token cache is being invalidate because project 647e7d9c4d1f47738f0ea7399f4a515e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:31.114052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.115431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.117874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 898/1800] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:30 2022] DELETE /identity/v3/projects/647e7d9c4d1f47738f0ea7399f4a515e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:31.121764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.123173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:31.138902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.139513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.139825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.140060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.140783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.143063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.187355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 903/1801] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:30 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:31.188452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.190805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:31.246181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8738cd-41a2-48c6-b843-e4ce8b197b00 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.288647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e168a-4fa9-47eb-8dad-5bacfe2b18e0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.293773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.294829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.294946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.295296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.296114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.298793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.305684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:31.330202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 904/1802] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:31 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:31.331122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.345015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2db42b-39a2-483b-aea8-c649c7d3b04b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.348700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.349303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.350625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.350625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.351372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.353040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.369165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.369715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.369853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 905/1803] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:31.370145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.370565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] PATH_INFO: `/v3/users/e38bb1f63b104a6c837137c1ea18ed6c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.370756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.372109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38bb1f63b104a6c837137c1ea18ed6c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.374350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.377991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:31.384299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938f7c0-870d-41df-96f4-826d95c28ec9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.405835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.406692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.406979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.407252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] PATH_INFO: `/v3/projects/fa0a64da239443e9a35acb894a1f0157/users/6f92491eacaf479a920a95adf974720f/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.445573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0a64da239443e9a35acb894a1f0157, user_id=6f92491eacaf479a920a95adf974720f, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.460917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.507324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 906/1804] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:31 2022] PUT /identity/v3/projects/fa0a64da239443e9a35acb894a1f0157/users/6f92491eacaf479a920a95adf974720f/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:31.510087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.513706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38bb1f63b104a6c837137c1ea18ed6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.551302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38bb1f63b104a6c837137c1ea18ed6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.578008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38bb1f63b104a6c837137c1ea18ed6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.585988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38bb1f63b104a6c837137c1ea18ed6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.588976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38bb1f63b104a6c837137c1ea18ed6c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:31.633150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 899/1805] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:31 2022] DELETE /identity/v3/users/e38bb1f63b104a6c837137c1ea18ed6c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:31.673581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed751da-91a7-4e6d-b194-471b1f1751fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.749641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.750354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.750731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.750886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.751531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.753268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d862a-cadc-406d-aa02-7e60386ef62a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.765141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 907/1806] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:31.768973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.770441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:31.786241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded977-110d-4cde-b1ac-7f0d746912a3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:31.793916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:31.794706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.794988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.795323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] PATH_INFO: `/v3/projects/fa0a64da239443e9a35acb894a1f0157/users/6f92491eacaf479a920a95adf974720f/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.797753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0a64da239443e9a35acb894a1f0157, user_id=6f92491eacaf479a920a95adf974720f, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:31.800826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:31.813294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 900/1807] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:31 2022] PUT /identity/v3/projects/fa0a64da239443e9a35acb894a1f0157/users/6f92491eacaf479a920a95adf974720f/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:31.825317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:31.825765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:31.826053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:31.860229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] MFA Rules not processed for user `6f92491eacaf479a920a95adf974720f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:31.861488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:31.962688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 908/1808] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:31.977615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:31.980439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.050397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a18a6-2fee-458a-9a82-282aace83e83 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.056289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.057087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.057371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.057661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.075637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.077621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855f799-c874-42cc-ab99-deda1930cf9d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.092624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 901/1809] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:32.107672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.110580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.157540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:32.257670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d85b2-549b-447a-9742-8ebb6db39c7d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.265938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.266627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.266911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.267191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] PATH_INFO: `/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.268609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1049dfa0a11a4b79b9814f2965b3e06a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.270881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.354741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1049dfa0a11a4b79b9814f2965b3e06a', 'request_id': 'req-48ad951a-f7ef-49eb-aa75-ed268973eb93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.364710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1049dfa0a11a4b79b9814f2965b3e06a', 'request_id': 'req-48ad951a-f7ef-49eb-aa75-ed268973eb93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.380108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1049dfa0a11a4b79b9814f2965b3e06a', 'request_id': 'req-48ad951a-f7ef-49eb-aa75-ed268973eb93'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.395269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] The token cache is being invalidate because project 1049dfa0a11a4b79b9814f2965b3e06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:32.395562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.396854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.402320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 909/1810] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:32 2022] DELETE /identity/v3/projects/1049dfa0a11a4b79b9814f2965b3e06a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:32.408335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463e28-c070-4eff-8c21-75524e2225f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.408686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463e28-c070-4eff-8c21-75524e2225f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.408929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463e28-c070-4eff-8c21-75524e2225f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.429847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.431229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.432796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-41463e28-c070-4eff-8c21-75524e2225f3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:32.433949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-41463e28-c070-4eff-8c21-75524e2225f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.482047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:32.499639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad951a-f7ef-49eb-aa75-ed268973eb93 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.501365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 902/1811] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:32.504364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.505053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.505332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.506186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] PATH_INFO: `/v3/users/e24213246b8b4986a71c877e1dd93516` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.507672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24213246b8b4986a71c877e1dd93516)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.509668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.511423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.511720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.511997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.532905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:32.534402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.543295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 903/1812] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:32.548416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.556230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:32.558971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2963a-9408-48a5-b15c-ebdca08f3344 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.562525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24213246b8b4986a71c877e1dd93516'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.565200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.565930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.566490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.566735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.567609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:32.567948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.570375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.572198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24213246b8b4986a71c877e1dd93516'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.573092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24213246b8b4986a71c877e1dd93516'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.573970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24213246b8b4986a71c877e1dd93516'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.581956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f47d4483-c491-40c6-adb8-1d3e8e45c8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24213246b8b4986a71c877e1dd93516'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:32.583358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 904/1813] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:32.588148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.589971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.602035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 910/1814] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:32 2022] DELETE /identity/v3/users/e24213246b8b4986a71c877e1dd93516 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:32.603461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5451-fc3b-43a6-be9b-d2d157e8c323 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.607879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.608605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.608605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.628253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:32.629577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.680977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.681894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.682181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.683153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.683856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.687953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.715493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 911/1815] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:32.725901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 905/1816] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:32.726089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.727284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.728299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:32.815880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc3d44-c995-40c9-9ba0-6745ca5b8cff None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.829921 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66ed39-0de7-4a4b-a65d-2e3574bc65b1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.842695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.843388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.843605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.843873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.845140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.847588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.882344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.884109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.884109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.884109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.890007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 906/1817] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:32 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:32.894670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.898813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.900369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.923972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e46ed-59c4-456d-b25a-57ec846296e9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.924856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 912/1818] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:32.931878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.932589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.932936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.933989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.933989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.935576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:32.951411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 907/1819] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:32.961799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:32.977823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f419e6-201b-4a73-a485-4d6cac6136be service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:32.986019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:32.987220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:32.987898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:32.988409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:32.989620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:32.993720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71256fc3-9458-4c23-be0b-1b3d70ee640c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:33.012929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 913/1820] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:33.019776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:33.048079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201a37-a5cc-41da-ad4f-b693c4e3517a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:33.057886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:33.059433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.059812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.060166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] PATH_INFO: `/v3/projects/6bdf293d855c4fa587682e65c86f1bfd/users/2cdfab47274545fea7bb8ad7d7fb22d6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.087588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdf293d855c4fa587682e65c86f1bfd, user_id=2cdfab47274545fea7bb8ad7d7fb22d6, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:33.092520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:33.115010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 908/1821] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:33 2022] PUT /identity/v3/projects/6bdf293d855c4fa587682e65c86f1bfd/users/2cdfab47274545fea7bb8ad7d7fb22d6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:33.128112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.128466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.129006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.148227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:33.176663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] MFA Rules not processed for user `2cdfab47274545fea7bb8ad7d7fb22d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:33.178872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:33.322791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 914/1822] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:33.336645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:33.336645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:33.348246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:33.428694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea12abc-7faf-4cd8-9117-1a284716032c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:33.433314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:33.433946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.434224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.434494 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.445260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:33.446710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75c11-c971-46c9-9c76-0e4ef3138eb4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:33.463552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 909/1823] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:33.487102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:33.563411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0f30e-efa7-4a1e-9d1b-424ae1ab6aba None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:33.569795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:33.570590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.570927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.571284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] PATH_INFO: `/v3/users/2cdfab47274545fea7bb8ad7d7fb22d6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.573174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdfab47274545fea7bb8ad7d7fb22d6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:33.575807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:33.635860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdfab47274545fea7bb8ad7d7fb22d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:33.644645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdfab47274545fea7bb8ad7d7fb22d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:33.645688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdfab47274545fea7bb8ad7d7fb22d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:33.646408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdfab47274545fea7bb8ad7d7fb22d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:33.654791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdfab47274545fea7bb8ad7d7fb22d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:33.686209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 915/1824] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:33 2022] DELETE /identity/v3/users/2cdfab47274545fea7bb8ad7d7fb22d6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:33.690455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.691204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.691204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.712787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:33.714011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:33.784573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 910/1825] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:33.795199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:33.797012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:33.823118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:33.873187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624549-fca7-4841-9064-7ff6bb9c1295 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:33.877378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:33.877999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:33.878280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:33.878746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:33.895669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:33.898629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:33.913566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 916/1826] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:34.007837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:34.010956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:34.037876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505169-7cd6-41d5-9998-dce2781a7f7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:34.046861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:34.047816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:34.048276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:34.048806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] PATH_INFO: `/v3/projects/50b9b73ac796410f8b6578b47c4e5579` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:34.052100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b9b73ac796410f8b6578b47c4e5579)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:34.056035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:34.181081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b9b73ac796410f8b6578b47c4e5579', 'request_id': 'req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.196132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b9b73ac796410f8b6578b47c4e5579', 'request_id': 'req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.207367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b9b73ac796410f8b6578b47c4e5579', 'request_id': 'req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.232038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] The token cache is being invalidate because project 50b9b73ac796410f8b6578b47c4e5579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:34.232454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.233461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.237958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:34 2022] DELETE /identity/v3/projects/50b9b73ac796410f8b6578b47c4e5579 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:34.239165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:34.257036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e9d28-8c57-47a2-a80b-a0cb88356391 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:34.366349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:34.367232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:34.367522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:34.367797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] PATH_INFO: `/v3/users/6f92491eacaf479a920a95adf974720f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:34.370336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f92491eacaf479a920a95adf974720f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:34.373816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:34.479826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f92491eacaf479a920a95adf974720f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.496779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f92491eacaf479a920a95adf974720f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.498610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f92491eacaf479a920a95adf974720f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.499920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f92491eacaf479a920a95adf974720f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.515715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e96565a5-3b69-4d8e-b0c0-92a6ae2ef724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f92491eacaf479a920a95adf974720f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:34.544343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 917/1828] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:34 2022] DELETE /identity/v3/users/6f92491eacaf479a920a95adf974720f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:34.686378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:34.689015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:34.746199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c0e4-1f4a-4bbe-a8ad-abf711c6b363 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:34.876593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:34.913449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:34.914404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:34.914881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:34.915433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] PATH_INFO: `/v3/projects/6bdf293d855c4fa587682e65c86f1bfd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:34.916877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdf293d855c4fa587682e65c86f1bfd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:34.930127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.001191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdf293d855c4fa587682e65c86f1bfd', 'request_id': 'req-1b297a44-a18b-4b30-bae4-cb9904ce533c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.011003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdf293d855c4fa587682e65c86f1bfd', 'request_id': 'req-1b297a44-a18b-4b30-bae4-cb9904ce533c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.023499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdf293d855c4fa587682e65c86f1bfd', 'request_id': 'req-1b297a44-a18b-4b30-bae4-cb9904ce533c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.043809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] The token cache is being invalidate because project 6bdf293d855c4fa587682e65c86f1bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:35.044156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.046845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.049977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 912/1829] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:34 2022] DELETE /identity/v3/projects/6bdf293d855c4fa587682e65c86f1bfd => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:35.057612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.058421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.058900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.093642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.095776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.097738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:35.099855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.144656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:35.187809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 918/1830] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:35.187809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.187809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.197499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5ab6c-5a9f-4ae2-8ba0-12e2ec8a21ca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.203641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.204932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.205491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.205960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] PATH_INFO: `/v3/projects/fa0a64da239443e9a35acb894a1f0157` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.207992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0a64da239443e9a35acb894a1f0157)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.210228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.220924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b297a44-a18b-4b30-bae4-cb9904ce533c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.227720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.228782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.229509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.229860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] PATH_INFO: `/v3/users/56e3e3e106304be782bf64b6fed20a37` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.231961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e3e3e106304be782bf64b6fed20a37)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.234445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.303872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e3e3e106304be782bf64b6fed20a37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.307546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0a64da239443e9a35acb894a1f0157', 'request_id': 'req-3efd1b57-6a72-420a-9244-cb9bc20ecce0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.318089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e3e3e106304be782bf64b6fed20a37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.320043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0a64da239443e9a35acb894a1f0157', 'request_id': 'req-3efd1b57-6a72-420a-9244-cb9bc20ecce0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.321535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:35.332998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0a64da239443e9a35acb894a1f0157', 'request_id': 'req-3efd1b57-6a72-420a-9244-cb9bc20ecce0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.335380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e3e3e106304be782bf64b6fed20a37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.336640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e3e3e106304be782bf64b6fed20a37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.338381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fab64a88-a2a2-4d94-b517-fb55bc39079e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e3e3e106304be782bf64b6fed20a37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.349028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] The token cache is being invalidate because project fa0a64da239443e9a35acb894a1f0157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:35.350223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.351332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3efd1b57-6a72-420a-9244-cb9bc20ecce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:35.356903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 919/1831] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:35 2022] DELETE /identity/v3/projects/fa0a64da239443e9a35acb894a1f0157 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:35.359162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd87-961c-4722-ae1c-33a051848295 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.359418 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 913/1832] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:35 2022] DELETE /identity/v3/users/56e3e3e106304be782bf64b6fed20a37 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:35.359927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd87-961c-4722-ae1c-33a051848295 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.360469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204cd87-961c-4722-ae1c-33a051848295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.365096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.365443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.365728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.390174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d204cd87-961c-4722-ae1c-33a051848295 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:35.391528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d204cd87-961c-4722-ae1c-33a051848295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.396947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:35.399010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.482592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 920/1833] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:35.482592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366954-e9cc-4d43-8241-898732eb4f34 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.484096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366954-e9cc-4d43-8241-898732eb4f34 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.484357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00366954-e9cc-4d43-8241-898732eb4f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.510038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 914/1834] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:35.511126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.519805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-00366954-e9cc-4d43-8241-898732eb4f34 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:35.521566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00366954-e9cc-4d43-8241-898732eb4f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.531408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 921/1835] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:35.532857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.533149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.533430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.553746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55f19-aea1-4297-be06-5eb760217406 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.558329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:35.559675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.562335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.563666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.564026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.564513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.565528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:35.565839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.568757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.578546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 922/1836] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:35.580644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.588165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:35.603938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 915/1837] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:35.603938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.630104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd332a-617b-44ed-9826-42478ce8ae95 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.642432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.643256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.643545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.643822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.644510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:35.644827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.646797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.668747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 916/1838] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:35.668747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.682360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:35.684376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9347b-cbf6-48b8-918c-32eaade502cf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.697332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.699181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.699648 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.700345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.700550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbe137-4695-45a1-92a5-0f18b6bd9ffe None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.701627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.705126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.707101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.708146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.708838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.709376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.719699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.722211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.738270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 923/1839] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:35.739797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.740614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 917/1840] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:35.744282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.753380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361848ad-3fb2-48fd-a780-4075657b16db service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.826619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.827277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.827627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.828000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.830200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.836129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aeadf-9c14-412e-9df4-fa6e2b6b43fc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.841324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.841989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.842283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.842773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.843182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.845487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.846094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.879968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 918/1841] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/users => generated 281 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:35.884740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.914828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb068-db12-4e7c-b368-ab6db585b65b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.920219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:35.920645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 924/1842] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/projects => generated 409 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:35.920959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:35.921503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:35.921838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:35.923406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:35.924929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:35.928018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.943814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 919/1843] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:35.947549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:35.973831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11314be-3625-4735-b9bd-102e14951848 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:35.990853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:36.038203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42241ff-a676-4996-9121-b4c281e58f39 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.044593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.045811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.046278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.046760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.047600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.049897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.086457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 925/1844] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:35 2022] POST /identity/v3/users => generated 305 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:36.094035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.108115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.110099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.110221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.110442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.112289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.114176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.118172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03fc33-5387-41ed-99fc-f2558caa48a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.127222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.127859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.128140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.128416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.129168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.129965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 920/1845] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:36.131572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.134021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.145012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 926/1846] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:36.148274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202046-86a6-439b-998c-0d18fc136c4c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.149669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.154620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.155839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.159033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.159033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] PATH_INFO: `/v3/projects/67e9d72640a44e529783dca1b9deef56/users/40267aae0cdf42688480b4453be70b0d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.164422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12241f8b-6d78-44db-92dd-033562b004d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.179023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e9d72640a44e529783dca1b9deef56, user_id=40267aae0cdf42688480b4453be70b0d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.182117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3df94-313b-499e-bdc8-f875cbd60017 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.191703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.192766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.198416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.198763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.199474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.203577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.204768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 921/1847] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:36 2022] PUT /identity/v3/projects/67e9d72640a44e529783dca1b9deef56/users/40267aae0cdf42688480b4453be70b0d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:36.218625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4c0b2-3484-4ded-8382-b6b206327fc0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.218922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4c0b2-3484-4ded-8382-b6b206327fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.224762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4c0b2-3484-4ded-8382-b6b206327fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.237436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 927/1848] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:36.238609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.252803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638c6c-7f6f-487a-bd78-edfff29e88e0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.280508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d7d4c0b2-3484-4ded-8382-b6b206327fc0 None None] MFA Rules not processed for user `40267aae0cdf42688480b4453be70b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:36.282474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d7d4c0b2-3484-4ded-8382-b6b206327fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.329088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:36.353487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.354359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.355116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.355116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] PATH_INFO: `/v3/projects/cf3d9ac56fe646d983a8e6b7f83142e6/users/dbf354626eff4e9fb39c3d7a0e6f56f8/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.380129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3d9ac56fe646d983a8e6b7f83142e6, user_id=dbf354626eff4e9fb39c3d7a0e6f56f8, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.383947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.404016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 928/1849] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:36 2022] PUT /identity/v3/projects/cf3d9ac56fe646d983a8e6b7f83142e6/users/dbf354626eff4e9fb39c3d7a0e6f56f8/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:36.408059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 922/1850] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:36.408205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.409233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.422635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.422966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.423245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.468760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] MFA Rules not processed for user `dbf354626eff4e9fb39c3d7a0e6f56f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:36.470343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.504529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e003-62cc-4f8e-b55d-d4b6c6f575c3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.510217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.510459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.510702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.510976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] PATH_INFO: `/v3/projects/5c35a64923884f39a051434cc041d7b3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.512364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c35a64923884f39a051434cc041d7b3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.514217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.547228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 923/1851] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:36.548166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.549487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.564186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:36.583418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c35a64923884f39a051434cc041d7b3', 'request_id': 'req-6ca3b13c-1010-4428-b41c-e720a7dd6484'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.591795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c35a64923884f39a051434cc041d7b3', 'request_id': 'req-6ca3b13c-1010-4428-b41c-e720a7dd6484'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.602509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c35a64923884f39a051434cc041d7b3', 'request_id': 'req-6ca3b13c-1010-4428-b41c-e720a7dd6484'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.617995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] The token cache is being invalidate because project 5c35a64923884f39a051434cc041d7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:36.619355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.620267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.625739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 929/1852] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:36 2022] DELETE /identity/v3/projects/5c35a64923884f39a051434cc041d7b3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:36.625739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.632759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.641373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6700e-7c82-43da-8d81-591d5488ada5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.697170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.697781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.698060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.698339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.700380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.710707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:36.717920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3b13c-1010-4428-b41c-e720a7dd6484 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.726027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.726739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.727088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.727434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.728611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.730439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.766445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 930/1853] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:36 2022] POST /identity/v3/projects => generated 407 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:36.768132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.770234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.770690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.773177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.784814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 924/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:36.785901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.802498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f10f7-2753-4ea3-b546-a7c4c865daf2 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.859212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d60fd-eb53-4d5d-82f6-91367c39b317 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.864960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.865851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.866411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.866837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] PATH_INFO: `/v3/users/9e68168c8c794f2b9e3f32630e6ae729` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.868438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e68168c8c794f2b9e3f32630e6ae729)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.870873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.876045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.876792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.877104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.877365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.878009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.880024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.912960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 925/1855] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:36 2022] POST /identity/v3/users => generated 310 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:36.912960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:36.918358 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:36.950157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e68168c8c794f2b9e3f32630e6ae729'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.951874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11ccb8-471a-454b-8e16-dd60ff91c182 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:36.959620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e68168c8c794f2b9e3f32630e6ae729'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.960304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e68168c8c794f2b9e3f32630e6ae729'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.960974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e68168c8c794f2b9e3f32630e6ae729'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.965543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:36.966207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:36.966486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:36.966755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] PATH_INFO: `/v3/users/40267aae0cdf42688480b4453be70b0d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:36.969297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40267aae0cdf42688480b4453be70b0d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:36.970082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e68168c8c794f2b9e3f32630e6ae729'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:36.972833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:36.976302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:36.994873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 931/1856] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:36 2022] DELETE /identity/v3/users/9e68168c8c794f2b9e3f32630e6ae729 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:36.996108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.002466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.047386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40267aae0cdf42688480b4453be70b0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.070278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40267aae0cdf42688480b4453be70b0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.080761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40267aae0cdf42688480b4453be70b0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.081916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40267aae0cdf42688480b4453be70b0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.083376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2201ec4b-8b01-47f6-b274-8edf1e075530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40267aae0cdf42688480b4453be70b0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.105194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 926/1857] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:36 2022] DELETE /identity/v3/users/40267aae0cdf42688480b4453be70b0d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:37.110363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.110934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.111602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.140657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:37.142270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.153376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cef56-fa9e-4dc9-9803-65f8c375df20 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.166601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:37.252214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.253241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.253733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.254160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.255074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.260217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.268677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 927/1858] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:37.269825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.277169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.277709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 932/1859] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:37.279548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.284032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.295782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53904c4f-db20-495c-a44c-e2e842790e70 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.301876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.302634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.303027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.304652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] PATH_INFO: `/v3/users/1f82b85146934e8daf37a8eb2f3428d7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.305549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f82b85146934e8daf37a8eb2f3428d7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.307891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.383126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f82b85146934e8daf37a8eb2f3428d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.398996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfe93c-10e0-4482-b7ab-e7b9af65d770 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.404622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.406732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.407370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.408038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.413007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f82b85146934e8daf37a8eb2f3428d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.423877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.425494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.429696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f82b85146934e8daf37a8eb2f3428d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.433476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f82b85146934e8daf37a8eb2f3428d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.435821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ab1dd534-b181-4fb3-88d5-7bdb79d5df54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f82b85146934e8daf37a8eb2f3428d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.439730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 933/1860] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:37.440788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.442372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.442545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:37.462381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea9cb-d8cc-45c0-96ce-903e5abf73be service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.468513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.469164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.469510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.469859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] PATH_INFO: `/v3/projects/9ad4073da54046dcbdac7a13a62311ac/users/a0adcd0a335e4a23a78c82f8ca73a9ce/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.472512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 928/1861] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:37 2022] DELETE /identity/v3/users/1f82b85146934e8daf37a8eb2f3428d7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:37.486689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.486981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.487264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.494213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad4073da54046dcbdac7a13a62311ac, user_id=a0adcd0a335e4a23a78c82f8ca73a9ce, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.497820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.524663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 934/1862] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:37 2022] PUT /identity/v3/projects/9ad4073da54046dcbdac7a13a62311ac/users/a0adcd0a335e4a23a78c82f8ca73a9ce/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:37.528502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.531263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.540217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:37.544747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.674825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 929/1863] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:37.675843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.679876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.705139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6429-3897-4dae-8187-ba8927ca4f98 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.714281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.714824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2751894-0749-480f-ac46-733aaeebcee4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.716928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.717217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.718387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.718975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.722016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.727567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.728342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.728647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.729070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] PATH_INFO: `/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.730250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c08fa85b73469fbec4b77cbf6a235e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:37.733984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:37.736848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 935/1864] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:37.738347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.741719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.774714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:37.825863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e0df6-a1c5-4bdf-b511-0e7bc79d0f8d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:37.838770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c08fa85b73469fbec4b77cbf6a235e', 'request_id': 'req-3be5141e-34a7-4994-bcce-68c78faddbd2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.853172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c08fa85b73469fbec4b77cbf6a235e', 'request_id': 'req-3be5141e-34a7-4994-bcce-68c78faddbd2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.864317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c08fa85b73469fbec4b77cbf6a235e', 'request_id': 'req-3be5141e-34a7-4994-bcce-68c78faddbd2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.879920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] The token cache is being invalidate because project a2c08fa85b73469fbec4b77cbf6a235e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:37.881363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.881884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:37.883610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 930/1865] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:37 2022] DELETE /identity/v3/projects/a2c08fa85b73469fbec4b77cbf6a235e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:37.884442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:37.887517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.917839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:37.918573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:37.918780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:37.919026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:37.921718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:37.997021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5141e-34a7-4994-bcce-68c78faddbd2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:38.013559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:38.014407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.014929 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.015218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] PATH_INFO: `/v3/projects/9ad4073da54046dcbdac7a13a62311ac/users/a0adcd0a335e4a23a78c82f8ca73a9ce/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.028748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad4073da54046dcbdac7a13a62311ac, user_id=a0adcd0a335e4a23a78c82f8ca73a9ce, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.028956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.030619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae411e9-2dc7-4da6-b49c-9b3d5909b587 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.032799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4930b4-dfc8-4b4b-bc19-2f1829612c3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.045401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 936/1866] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:38.047428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.048237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.048958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.061994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 931/1867] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:37 2022] PUT /identity/v3/projects/9ad4073da54046dcbdac7a13a62311ac/users/a0adcd0a335e4a23a78c82f8ca73a9ce/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:38.073598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1844-adc6-49fe-818e-bbc91963e436 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.073970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1844-adc6-49fe-818e-bbc91963e436 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.074371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1844-adc6-49fe-818e-bbc91963e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.079610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.082525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.122672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:38.136065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-082b1844-adc6-49fe-818e-bbc91963e436 None None] MFA Rules not processed for user `a0adcd0a335e4a23a78c82f8ca73a9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.138574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-082b1844-adc6-49fe-818e-bbc91963e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.203254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 937/1868] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:38.203254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:38.205477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.220445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b26ff-face-4165-a4f0-77b537e5fb0a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:38.227500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:38.228740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.229099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.229499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] PATH_INFO: `/v3/projects/67e9d72640a44e529783dca1b9deef56` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.231019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e9d72640a44e529783dca1b9deef56)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.233690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.265434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:38.266214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 932/1869] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:38.267710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f9e5-6676-40a2-b5d6-45b3db6ab229 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.268839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f9e5-6676-40a2-b5d6-45b3db6ab229 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.269303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f9e5-6676-40a2-b5d6-45b3db6ab229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.312654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e9d72640a44e529783dca1b9deef56', 'request_id': 'req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.314825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4915f9e5-6676-40a2-b5d6-45b3db6ab229 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.316067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4915f9e5-6676-40a2-b5d6-45b3db6ab229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.330648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e9d72640a44e529783dca1b9deef56', 'request_id': 'req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.358671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e9d72640a44e529783dca1b9deef56', 'request_id': 'req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.394377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] The token cache is being invalidate because project 67e9d72640a44e529783dca1b9deef56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:38.394749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.398378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.402505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 938/1870] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:38 2022] DELETE /identity/v3/projects/67e9d72640a44e529783dca1b9deef56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:38.402505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:38.403577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.492149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 933/1871] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:38.492149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203fef-9816-4a99-934f-fcff7c5073f1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.492149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203fef-9816-4a99-934f-fcff7c5073f1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.492149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82203fef-9816-4a99-934f-fcff7c5073f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.530217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-82203fef-9816-4a99-934f-fcff7c5073f1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.533848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1cdb2-2c22-4c7c-b8ef-c91e6a19712f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:38.538897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:38.539532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.539867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.540217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.542874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.547834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82203fef-9816-4a99-934f-fcff7c5073f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.559574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 934/1872] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:38.571759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6b4a-b237-4389-af89-b88aaa23998f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.572075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6b4a-b237-4389-af89-b88aaa23998f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.572539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e6b4a-b237-4389-af89-b88aaa23998f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.574239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 935/1873] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:03:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:03:38.574979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e6b4a-b237-4389-af89-b88aaa23998f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:38.619896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e6b4a-b237-4389-af89-b88aaa23998f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:38.637424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:38.638047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.638956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.638956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.639233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:38.643527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.647533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.692456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 936/1874] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:38.694068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:38.701800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.725635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.727115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2acec4-4a15-4256-a551-8593b0870c87 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.736174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4f513-4b18-4880-abca-f44724cf206c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:38.745480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:38.746137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.746421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.746700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] PATH_INFO: `/v3/projects/44e348ce78bd4df0afae251ff9eaaff1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.749769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e348ce78bd4df0afae251ff9eaaff1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:38.752252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:38.756454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 939/1875] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:38 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:38.758373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08cc-219f-45ec-be1f-391a7bae1b26 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.758679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08cc-219f-45ec-be1f-391a7bae1b26 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.759343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08cc-219f-45ec-be1f-391a7bae1b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.811794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9acd08cc-219f-45ec-be1f-391a7bae1b26 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.813422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9acd08cc-219f-45ec-be1f-391a7bae1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.831138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 940/1876] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:38.832152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:38.832470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:38.832746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:38.872879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e348ce78bd4df0afae251ff9eaaff1', 'request_id': 'req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.882721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:38.883970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:38.887577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e348ce78bd4df0afae251ff9eaaff1', 'request_id': 'req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.899028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e348ce78bd4df0afae251ff9eaaff1', 'request_id': 'req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.916496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:38.929101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] The token cache is being invalidate because project 44e348ce78bd4df0afae251ff9eaaff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:38.930405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.931145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:38.934554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 937/1877] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:38 2022] DELETE /identity/v3/projects/44e348ce78bd4df0afae251ff9eaaff1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:38.935326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:38.941458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.012390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:39.097260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 941/1878] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:39.100605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.102436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.164342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49d48-dfbc-487d-aac0-4e3656d0fce3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.170427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.171239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.171695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.172163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.173122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.175342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.202626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bc918-0f9c-4f69-9edd-458728c80592 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.209371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.209704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.210195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.210518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.211240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:39.211639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.213512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.223207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 938/1879] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:38 2022] POST /identity/v3/projects => generated 363 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:39.228373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.230693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 942/1880] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:39.231838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.233049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.236550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.311606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f468f4-2342-4fb8-a058-138bf08304dc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.316868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.317529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.317910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.319337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] PATH_INFO: `/v3/users/ed60d485d90641e6861ffe704bdcc677` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.320571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed60d485d90641e6861ffe704bdcc677)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.322557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.337548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740cdbe-3644-4063-9f38-8995b5ab5d88 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.394081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed60d485d90641e6861ffe704bdcc677'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:39.412973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed60d485d90641e6861ffe704bdcc677'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:39.419573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.420731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.421365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.422195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.424238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed60d485d90641e6861ffe704bdcc677'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:39.425158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed60d485d90641e6861ffe704bdcc677'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:39.425548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.425854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed60d485d90641e6861ffe704bdcc677'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:39.448705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 939/1881] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:39 2022] DELETE /identity/v3/users/ed60d485d90641e6861ffe704bdcc677 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:39.449770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.451668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.457701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:39.538237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bf24c-62cb-4bc3-acac-e648eeed9276 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.543696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.544688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.544967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.545288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.545937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.548247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.553117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:39.578342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.580108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.580246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 940/1882] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:39 2022] POST /identity/v3/users => generated 282 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:39.581191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.584905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.600797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 943/1883] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:39 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:39.601669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.602502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43064b-3e88-4686-8d1e-058619ff771b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.605627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:39.613821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.614456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.615388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.615862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.617081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.619127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.690930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 941/1884] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:39 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:39.690930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.737351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b500a7-3d22-4a2e-ad51-a2a9a22d461c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.819041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020dfa-ca17-486f-a814-93f557dd9890 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.825677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.826462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.826830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.827286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.828414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.830927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.851040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 942/1885] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:39.851040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.868721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80c18-ea3e-4b07-aae0-ae5e08668c54 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.878881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.880163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.880850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.881500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.883313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.888205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.939236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 943/1886] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:39 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:39.940664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:39.958724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914411f7-1e18-4e4c-b29b-6947433cf661 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:39.967277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.968070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.969869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.970532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.971858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:39.975987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:39.980437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:39.982421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:39.985316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:39.985842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:39.987944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.007931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 944/1887] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:40.009054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.020899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.022650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.040670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984baf-a866-4cba-bce2-9b00ecbb769f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.047243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 944/1888] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:40.048002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.069474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.070285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.070655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.071530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.072581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.077537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.079106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62de8-8a53-4253-b143-db520a14450f service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.097888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.100947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.101293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.101577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] PATH_INFO: `/v3/projects/66c0ba953e1a4486b7ec3652a80a5983/users/75a13a8eb00043afa75379a4a6fd9334/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.114628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 945/1889] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:40.114628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.117067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.146040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888afe3-8712-4235-bc13-c252bd0c2794 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.159992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.162088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.167518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.167648 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] PATH_INFO: `/v3/projects/32e244d2635e42529f126ad4499096ee` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.171031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c0ba953e1a4486b7ec3652a80a5983, user_id=75a13a8eb00043afa75379a4a6fd9334, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.172740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e244d2635e42529f126ad4499096ee)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.178810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.182466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.216078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 945/1890] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:40 2022] PUT /identity/v3/projects/66c0ba953e1a4486b7ec3652a80a5983/users/75a13a8eb00043afa75379a4a6fd9334/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:40.216078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.250391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:40.315895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e244d2635e42529f126ad4499096ee', 'request_id': 'req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:40.332024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e244d2635e42529f126ad4499096ee', 'request_id': 'req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:40.352690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e244d2635e42529f126ad4499096ee', 'request_id': 'req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:40.358440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:40.396031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] The token cache is being invalidate because project 32e244d2635e42529f126ad4499096ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:40.396876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:40.401178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2f9c3a8c-a4fb-4e20-8d12-0b89643f00d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:40.415769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 946/1891] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:40 2022] DELETE /identity/v3/projects/32e244d2635e42529f126ad4499096ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:40.415769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.415769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.415769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.422896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320375-ae6f-4e93-89eb-27edb01c5fea admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.485701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] MFA Rules not processed for user `75a13a8eb00043afa75379a4a6fd9334`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:40.486960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.561651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.562777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.563255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.563724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.565154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.567157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ad54e-894a-4711-879c-1ca8d7aeb9ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.581364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 946/1892] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:40.583142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.583837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.584414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.612453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:40.614136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.616920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 947/1893] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:40.618103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.619749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.625810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 947/1894] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:40.626946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.628452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.636090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e4b30-fc4b-40ae-bffc-42b224fd43be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.642019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.642666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.642950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.643230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] PATH_INFO: `/v3/projects/871e02c3026d4dfe95f69d65ef5d72a1/users/a7620cc2a4bf40158baca2880aa3a198/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.643378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1b02-ea9d-4c13-87eb-9cefad064d67 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.650795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.651715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.652152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.652598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.653358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.656111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc035d2-90fc-40fd-9cc4-c5939d942563 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.660891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871e02c3026d4dfe95f69d65ef5d72a1, user_id=a7620cc2a4bf40158baca2880aa3a198, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.664437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7e25-e4e6-4bfe-b14c-c8da38b5fab1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.680384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 948/1895] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:40 2022] PUT /identity/v3/projects/871e02c3026d4dfe95f69d65ef5d72a1/users/a7620cc2a4bf40158baca2880aa3a198/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:40.682079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.682401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.682813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.717798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 948/1896] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:40.717798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f776-8395-4527-8e44-50ff796d23af None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.717798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f776-8395-4527-8e44-50ff796d23af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.717798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182f776-8395-4527-8e44-50ff796d23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.747225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:40.748618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.769198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2182f776-8395-4527-8e44-50ff796d23af None None] MFA Rules not processed for user `a7620cc2a4bf40158baca2880aa3a198`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:40.770556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2182f776-8395-4527-8e44-50ff796d23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:40.865969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 949/1897] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:40.866901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.878440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f68d5c-84de-48cd-bd54-808b568ca826 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.884252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 949/1898] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:40.884252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f776-8395-4527-8e44-50ff796d23af None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.889386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.890530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.890816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.891100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.891735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.893796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.893982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182f776-8395-4527-8e44-50ff796d23af None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.899755 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.900369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.900690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.900961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.901768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:40.902072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.903675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.916750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:40.918888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 950/1899] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:40.919926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.928146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 950/1900] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:40.929076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.933301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6618d4d-0f8b-4751-a7d9-422a5699fdca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.938021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.938619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.938908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.939174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.939821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.940296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69afa06-3f6b-4d0f-b355-788969b5222f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:40.941877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.945917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:40.946642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:40.947023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:40.947400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:40.948124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:40.950188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:40.971041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 951/1901] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:40.972234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.982499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 951/1902] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:40.983737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:40.994351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:41.039610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a0f5-2e3a-40e1-9576-688069fe7fcd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.044339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.044979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.045270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.045546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.046186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.047288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0d49-19fc-4143-9d40-71b2b626d73b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.047798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.052106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.053311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.053585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.053863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.054610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.056593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.058708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 952/1903] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.059506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.072081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3ac0-3d80-4809-8bc4-45719a7a6df8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.076961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.077561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.077844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.078116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.078741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.080953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.084822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 952/1904] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:40 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:41.084822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.092842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d73fb-83f8-4430-9afb-d6d918e42ed5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.098714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.100097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.100607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.100883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] PATH_INFO: `/v3/projects/7fc3227ab645439e823e183f5a583519/users/8ab9bd3331cc4d018b0daacb9259d849/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.104592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 953/1905] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:41 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:41.105115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.114615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dcfff-789d-4c4f-90eb-ee1ed9263f2b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.118979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3227ab645439e823e183f5a583519, user_id=8ab9bd3331cc4d018b0daacb9259d849, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.120050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.120680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.120962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.121236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.121672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.121872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.123449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.135304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 954/1906] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.135861 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 953/1907] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:41 2022] PUT /identity/v3/projects/7fc3227ab645439e823e183f5a583519/users/8ab9bd3331cc4d018b0daacb9259d849/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:41.135970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.139511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.148350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c7e7-12f5-49a6-9511-99dc0c5d329a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.202772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd624e-840a-4fb1-98e9-5b3a1be7d36a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.204730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.205337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.205614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.205880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.206513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.207895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.208089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.209239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.209598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.209886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.210537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.212105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.218591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 955/1908] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.219359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.224975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 954/1909] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.224975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.232231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c78f5-b6e3-4aef-a0ac-bc58a323f20d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.234870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd264a-7b55-44d4-9a9f-653d43f77f8f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.241395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.241902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.242040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.242276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.242559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.242835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.243201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] PATH_INFO: `/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210/users/196f7e568cf94a8589cde7bdb99584b3/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.243771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.244792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.247603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.259911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccea1b25e1f4d1fb53c8ba06828e210, user_id=196f7e568cf94a8589cde7bdb99584b3, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.263682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 955/1910] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.263682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.264025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.275678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014e1f-88ef-4643-96be-373def8f64c7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.281975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 956/1911] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:41 2022] PUT /identity/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210/users/196f7e568cf94a8589cde7bdb99584b3/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:41.281975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.305745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:41.344601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.345289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.345547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.345824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] PATH_INFO: `/v3/projects/7fc3227ab645439e823e183f5a583519/users/8ab9bd3331cc4d018b0daacb9259d849/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.347853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3227ab645439e823e183f5a583519, user_id=8ab9bd3331cc4d018b0daacb9259d849, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.353975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:41.358555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.358874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecd322-e80a-45ec-b58c-bb856881f5ac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.366498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.367787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.368510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.368925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] PATH_INFO: `/v3/projects/eaa347b0bc474cf5a7fcde923ed3285c/users/b2f3d6f48ca34b23a1b65fbaf2717b11/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.384228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 956/1912] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:41 2022] PUT /identity/v3/projects/7fc3227ab645439e823e183f5a583519/users/8ab9bd3331cc4d018b0daacb9259d849/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:41.385644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.411256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa347b0bc474cf5a7fcde923ed3285c, user_id=b2f3d6f48ca34b23a1b65fbaf2717b11, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.415280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4570e-f069-4bf6-83e3-1096a2c41001 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.444865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 957/1913] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:41 2022] PUT /identity/v3/projects/eaa347b0bc474cf5a7fcde923ed3285c/users/b2f3d6f48ca34b23a1b65fbaf2717b11/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:41.448431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6bd1-78d9-4ddd-8181-69bb42639329 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.448675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6bd1-78d9-4ddd-8181-69bb42639329 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.448952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6bd1-78d9-4ddd-8181-69bb42639329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.498758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a2ad6bd1-78d9-4ddd-8181-69bb42639329 None None] MFA Rules not processed for user `8ab9bd3331cc4d018b0daacb9259d849`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:41.500340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a2ad6bd1-78d9-4ddd-8181-69bb42639329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:41.545766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756310d-8d7a-4be5-87a5-8d465c7a938a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.601319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 958/1914] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:41.607645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.607839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.608118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.633932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.635524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.635877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.636455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.637776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.640175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.641815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] MFA Rules not processed for user `b2f3d6f48ca34b23a1b65fbaf2717b11`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:41.643460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:41.666039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 957/1915] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:41.668066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.675536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:41.769032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 959/1916] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:41.769032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.791579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113496a-11a8-4d66-a22a-d539b353fd02 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.800985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6306-aafc-4db6-96bc-f19ad3388033 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:41.801191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.802248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.802629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.803036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] PATH_INFO: `/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210/users/196f7e568cf94a8589cde7bdb99584b3/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.806722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:41.806906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.807114 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.807391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.812892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccea1b25e1f4d1fb53c8ba06828e210, user_id=196f7e568cf94a8589cde7bdb99584b3, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.816057 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.823870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:41.843074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 960/1917] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:41 2022] PUT /identity/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210/users/196f7e568cf94a8589cde7bdb99584b3/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:41.843074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:41.843516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78d2b1-c363-4e5c-a223-5f21ec7b1053 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:41.873781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 958/1918] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:41.875798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:41.876313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:41.876765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:41.904748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:41.938808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] MFA Rules not processed for user `196f7e568cf94a8589cde7bdb99584b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:41.940136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:41.940451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:41.998673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc03b0b-11c6-4522-9523-755b86c48913 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.009898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.010921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.011207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.011539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.012413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.015047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.064324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 961/1919] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:41 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:42.065730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.092959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 959/1920] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:42.095179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.120098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241836-aeb7-426e-8dc4-6eaf6c9dcf6f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.158984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579912-1f12-496d-96a2-a0ec78f5aead admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.165090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.166622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.167000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.167682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.227641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.228649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.229135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.229651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.230650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.232864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.269683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 960/1921] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:42 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:42.272006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.274644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:42.288929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.290406 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.290621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3de18f-5b17-453a-87c7-04b0d8a824b3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.294382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.294987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.295261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.295535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.299472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 962/1922] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:42.300269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.311445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7a2c-20ec-4d79-bb58-045e2beeb81c service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.316105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.316736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.317014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.317286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.318820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.320628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.332174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 963/1923] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:42.336631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.349745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97b4f-cafb-44dc-a416-4af8fef0c8ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.357301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.358339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.359043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.359332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.359980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.361655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.365539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.368208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4c22-03d3-4402-958e-1a38ca1f6cd0 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.379789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 964/1924] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:42.381103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.386310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 961/1925] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:42.394004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee913d-706a-41b1-9417-31f3b9dd0cd1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.400215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.401429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.401929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.402410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] PATH_INFO: `/v3/projects/d44b77a448434ad9afe19227dfa8c962/users/5cb94fcdc8204d15951ec4f9a770fb5e/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.422055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44b77a448434ad9afe19227dfa8c962, user_id=5cb94fcdc8204d15951ec4f9a770fb5e, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.424923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.454610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 965/1926] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:42 2022] PUT /identity/v3/projects/d44b77a448434ad9afe19227dfa8c962/users/5cb94fcdc8204d15951ec4f9a770fb5e/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:42.466343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.466628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.466895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.542060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] MFA Rules not processed for user `5cb94fcdc8204d15951ec4f9a770fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:42.543740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:42.555090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:42.640417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 962/1927] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:42.644697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.732899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:42.783324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838fcb2-daf4-4bdb-bb8c-75f33b057f66 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.789654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.790416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.790695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.791025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.791664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.804178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:42.860560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 966/1928] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:42 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:42.866918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:42.882643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40a127-c82d-45ed-bbcb-1c42643ef15a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:42.969431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:42.970063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:42.970390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:42.970881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:42.972185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:42.976745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.013742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 963/1929] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:42 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:43.017826 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:43.029123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7953fc-8044-4274-8d6b-df6e89deacbb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:43.034854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:43.035471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.035757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.036063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.037023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:43.038827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.050544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 967/1930] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:43.055587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:43.067589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6d14e-edf6-4992-b3d7-e708bb6412f8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:43.074602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:43.075226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.075580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.075919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] PATH_INFO: `/v3/projects/498b09339dc54f62b12dc8681e68a413/users/c44e09a4c2ca4d4aacfcf3d5b69889dd/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.093704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498b09339dc54f62b12dc8681e68a413, user_id=c44e09a4c2ca4d4aacfcf3d5b69889dd, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:43.096355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.112535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 964/1931] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:43 2022] PUT /identity/v3/projects/498b09339dc54f62b12dc8681e68a413/users/c44e09a4c2ca4d4aacfcf3d5b69889dd/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:43.116210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:43.126656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e4d0-35cf-4ace-b286-453e7e1a4bb1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:43.207550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:43.208171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.209584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.210413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.210627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:43.212258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d2306-9c3c-470f-9a76-5451322de3a7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.227827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 968/1932] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:43.232010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:43.244421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0214a28-c80a-4d6d-be24-fdf090ca1b02 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:43.249397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:43.250098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.250369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.250984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] PATH_INFO: `/v3/projects/498b09339dc54f62b12dc8681e68a413/users/c44e09a4c2ca4d4aacfcf3d5b69889dd/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.257315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498b09339dc54f62b12dc8681e68a413, user_id=c44e09a4c2ca4d4aacfcf3d5b69889dd, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:43.259974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.278313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 965/1933] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:43 2022] PUT /identity/v3/projects/498b09339dc54f62b12dc8681e68a413/users/c44e09a4c2ca4d4aacfcf3d5b69889dd/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:43.288558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.288854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.289152 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.322581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] MFA Rules not processed for user `c44e09a4c2ca4d4aacfcf3d5b69889dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:43.323976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:43.402750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 969/1934] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:43.413854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:43.474498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05ff9d-fc34-4a7c-8624-6d0965c35664 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:43.479122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:43.479742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:43.480025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:43.480302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:43.491800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:43.494277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:43.507624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 966/1935] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:44.403972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:44.422566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff57e6-7754-4981-a2eb-ac6172f8d8b9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:44.440833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:44.441951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:44.442419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:44.442745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:44.485754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:44.536001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:44.536001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f6d0d-7b98-4f0a-b8a0-2afeb0cca201 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:44.555244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 970/1936] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:45.369793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:45.376943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:45.454783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b5115-4748-4f74-ad56-cfdfd63aefa8 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:45.461723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:45.462507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:45.463022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:45.463380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] PATH_INFO: `/v3/users/a7620cc2a4bf40158baca2880aa3a198` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:45.465038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7620cc2a4bf40158baca2880aa3a198)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:45.468232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:45.583095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7620cc2a4bf40158baca2880aa3a198'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:45.603439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7620cc2a4bf40158baca2880aa3a198'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:45.617877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7620cc2a4bf40158baca2880aa3a198'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:45.618916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7620cc2a4bf40158baca2880aa3a198'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:45.619585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7620cc2a4bf40158baca2880aa3a198'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:45.643182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 967/1937] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:45 2022] DELETE /identity/v3/users/a7620cc2a4bf40158baca2880aa3a198 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:45.650783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:45.651335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:45.652110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:45.690246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:45.691461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:45.776180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 971/1938] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:45.805127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:45.806664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:45.861891 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:45.866571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:45.894113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cbfe6-b077-4257-9873-26a8b4f20eda None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:45.905326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:45.906092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:45.906485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:45.906860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] PATH_INFO: `/v3/users/dbf354626eff4e9fb39c3d7a0e6f56f8` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:45.909410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf354626eff4e9fb39c3d7a0e6f56f8)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:45.911940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:45.946325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273a918-437f-4ec4-b929-1a81de1a7995 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:45.952015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:45.953157 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:45.953499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:45.953777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:45.970481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:45.973384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c909a-9447-4fc6-a2a9-63671568c67a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:46.005223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 968/1939] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:46.017055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf354626eff4e9fb39c3d7a0e6f56f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.028301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf354626eff4e9fb39c3d7a0e6f56f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.029405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf354626eff4e9fb39c3d7a0e6f56f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.030338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf354626eff4e9fb39c3d7a0e6f56f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.040367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf354626eff4e9fb39c3d7a0e6f56f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.077795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 972/1940] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:45 2022] DELETE /identity/v3/users/dbf354626eff4e9fb39c3d7a0e6f56f8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:46.082571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:46.082935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:46.083933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:46.120172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:46.121513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:46.146644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:46.207027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 969/1941] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:46.229405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:46.231483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:46.345239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:46.378542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee0583-f5ab-43f9-a30f-3a2f549b2f99 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:46.384145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:46.384968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:46.385224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:46.385725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:46.398714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:46.400314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:46.411162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 973/1942] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:46.713666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:46.715626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:46.753198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3cbf0-abe9-4d6b-93e2-e6b50d5ed7e9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:46.769338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:46.770436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:46.772527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:46.773399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] PATH_INFO: `/v3/projects/871e02c3026d4dfe95f69d65ef5d72a1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:46.775992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871e02c3026d4dfe95f69d65ef5d72a1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:46.781001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:46.854659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871e02c3026d4dfe95f69d65ef5d72a1', 'request_id': 'req-4456ba83-3572-434e-8bf6-699c0c403f63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.863356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871e02c3026d4dfe95f69d65ef5d72a1', 'request_id': 'req-4456ba83-3572-434e-8bf6-699c0c403f63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.874084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871e02c3026d4dfe95f69d65ef5d72a1', 'request_id': 'req-4456ba83-3572-434e-8bf6-699c0c403f63'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.886637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] The token cache is being invalidate because project 871e02c3026d4dfe95f69d65ef5d72a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:46.886930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.890138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:46.891379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:46.891824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 970/1943] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:46 2022] DELETE /identity/v3/projects/871e02c3026d4dfe95f69d65ef5d72a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:46.892835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:46.895456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:46.897312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:46.910236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4529f2-1966-4f42-928a-6f1bab503779 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:46.991727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ba83-3572-434e-8bf6-699c0c403f63 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:46.994441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:46.997146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:46.997799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:46.998080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:46.998352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] PATH_INFO: `/v3/users/196f7e568cf94a8589cde7bdb99584b3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:46.999712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196f7e568cf94a8589cde7bdb99584b3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:47.001674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:47.005308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:47.005630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:47.005864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] PATH_INFO: `/v3/projects/cf3d9ac56fe646d983a8e6b7f83142e6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:47.007986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3d9ac56fe646d983a8e6b7f83142e6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:47.012013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:47.084466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196f7e568cf94a8589cde7bdb99584b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.093514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:47.107887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196f7e568cf94a8589cde7bdb99584b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.113285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3d9ac56fe646d983a8e6b7f83142e6', 'request_id': 'req-5629d70d-dd2c-4d07-8467-d1736f3052e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.124720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196f7e568cf94a8589cde7bdb99584b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.124720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196f7e568cf94a8589cde7bdb99584b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.124909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3d9ac56fe646d983a8e6b7f83142e6', 'request_id': 'req-5629d70d-dd2c-4d07-8467-d1736f3052e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.125692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196f7e568cf94a8589cde7bdb99584b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.144760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3d9ac56fe646d983a8e6b7f83142e6', 'request_id': 'req-5629d70d-dd2c-4d07-8467-d1736f3052e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.154576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 971/1944] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:46 2022] DELETE /identity/v3/users/196f7e568cf94a8589cde7bdb99584b3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:47.179366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] The token cache is being invalidate because project cf3d9ac56fe646d983a8e6b7f83142e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:47.179990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.182128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.185749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 974/1945] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:46 2022] DELETE /identity/v3/projects/cf3d9ac56fe646d983a8e6b7f83142e6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:47.189736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:47.199601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:47.319391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f35865-a0c6-4628-ac9c-feb8c4bab2e7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:47.324788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:47.325506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:47.325853 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:47.326283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] PATH_INFO: `/v3/users/a0adcd0a335e4a23a78c82f8ca73a9ce` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:47.327700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0adcd0a335e4a23a78c82f8ca73a9ce)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:47.329992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:47.412370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0adcd0a335e4a23a78c82f8ca73a9ce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.428781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0adcd0a335e4a23a78c82f8ca73a9ce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.440329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0adcd0a335e4a23a78c82f8ca73a9ce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.441232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0adcd0a335e4a23a78c82f8ca73a9ce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.442063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0adcd0a335e4a23a78c82f8ca73a9ce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:47.471633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 972/1946] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:47 2022] DELETE /identity/v3/users/a0adcd0a335e4a23a78c82f8ca73a9ce => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:47.855812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:47.861710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:47.979863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629d70d-dd2c-4d07-8467-d1736f3052e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.031281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:48.096428 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.097477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.097937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.098970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] PATH_INFO: `/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.101414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccea1b25e1f4d1fb53c8ba06828e210)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.103547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.153650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.155599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.159606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccea1b25e1f4d1fb53c8ba06828e210', 'request_id': 'req-ba531da0-a798-4087-a3fc-7c774f0a46d1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.166992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccea1b25e1f4d1fb53c8ba06828e210', 'request_id': 'req-ba531da0-a798-4087-a3fc-7c774f0a46d1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.175763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccea1b25e1f4d1fb53c8ba06828e210', 'request_id': 'req-ba531da0-a798-4087-a3fc-7c774f0a46d1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.193831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897d61-2869-4ee1-8e0b-c88363463206 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.194533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] The token cache is being invalidate because project 6ccea1b25e1f4d1fb53c8ba06828e210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:48.194706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.195432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ba531da0-a798-4087-a3fc-7c774f0a46d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.200571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 975/1947] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:47 2022] DELETE /identity/v3/projects/6ccea1b25e1f4d1fb53c8ba06828e210 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:48.203222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb491b-0c12-4552-b23d-2fc3137e2ff7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.203511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb491b-0c12-4552-b23d-2fc3137e2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.203785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb491b-0c12-4552-b23d-2fc3137e2ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.226118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cdfb491b-0c12-4552-b23d-2fc3137e2ff7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:48.227364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdfb491b-0c12-4552-b23d-2fc3137e2ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.251799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:48.268532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.271735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.271735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.271735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] PATH_INFO: `/v3/projects/9ad4073da54046dcbdac7a13a62311ac` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.273094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad4073da54046dcbdac7a13a62311ac)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.275208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.304535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 976/1948] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:48.311797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.311968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.312421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.335341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:48.336596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.338000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad4073da54046dcbdac7a13a62311ac', 'request_id': 'req-6f89e5ff-8216-4509-94be-cc9ca089a83c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.344464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad4073da54046dcbdac7a13a62311ac', 'request_id': 'req-6f89e5ff-8216-4509-94be-cc9ca089a83c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.353607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad4073da54046dcbdac7a13a62311ac', 'request_id': 'req-6f89e5ff-8216-4509-94be-cc9ca089a83c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.367132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] The token cache is being invalidate because project 9ad4073da54046dcbdac7a13a62311ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:48.372916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.374524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6f89e5ff-8216-4509-94be-cc9ca089a83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:48.376399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 973/1949] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:48 2022] DELETE /identity/v3/projects/9ad4073da54046dcbdac7a13a62311ac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:48.384692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2457-44ba-4d6a-a61c-ddc7e7c23bc3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.385058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2457-44ba-4d6a-a61c-ddc7e7c23bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.385473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b2457-44ba-4d6a-a61c-ddc7e7c23bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.405328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:48.408025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6e9b2457-44ba-4d6a-a61c-ddc7e7c23bc3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:48.409247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6e9b2457-44ba-4d6a-a61c-ddc7e7c23bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.421617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 977/1950] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:48.425543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.434795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f35f7-d2a6-4920-b8da-d59afcfcb96b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.439737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.440418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.440735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.441009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.441649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:48.441950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.444135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.457910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 978/1951] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:48.463089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.473327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae479-c231-412c-a102-5b9fd313fc91 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.475632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 974/1952] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:48.483610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.483900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.484227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.486872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.487606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.487846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.488188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.488850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.490943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.512079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:48.513520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.521551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 979/1953] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:48.524848 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 975/1954] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:48.525835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.528139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.538616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa405b4a-409a-409c-aec6-4513bf4d9386 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.601282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577ba6-d84b-4047-b992-3ab8a4851bc5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.605977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.606572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.606836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.606960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.607142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.607483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.607768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.607887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:48.608071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.608181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.608833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.609748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.610786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.623370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 976/1955] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:48.627772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.638964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 980/1956] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:48.640402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.642335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3486-46f5-4aca-9a9d-0ce60d7515a6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.647540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.648249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.649338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.649338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.649558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.651430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.651876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fc1f3-65fb-4607-b662-952d5768311d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.656538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:48.656749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.657471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.657769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.658358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.660986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.663197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.674335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 981/1957] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:48.679011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.689748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dfd75-8751-4fa0-a55c-eb8a707a4306 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.695329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.696104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.696227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.696516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.697172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.701804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 977/1958] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:48.701942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.703728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.711611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 982/1959] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:48.715738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.733482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fbad-8e1c-414d-a87a-8c23cadbdd9f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.802951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.803616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.803893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.804164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] PATH_INFO: `/v3/projects/853edf763b51481fa63502e10ec4d241/users/9f4b21f022f34ff8bb72f8f88caa148d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.805553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa809c0-f5ae-4436-9e32-4cd656945511 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.815187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.815822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.816104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.816381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.817169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.819239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.822193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853edf763b51481fa63502e10ec4d241, user_id=9f4b21f022f34ff8bb72f8f88caa148d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.825112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec7c44-5716-4fcf-8d28-2cc80a51f187 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.844640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 983/1960] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:48 2022] PUT /identity/v3/projects/853edf763b51481fa63502e10ec4d241/users/9f4b21f022f34ff8bb72f8f88caa148d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:48.856962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.857477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.857679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.863070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 978/1961] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:48.864224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.876262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920006-437a-49f5-87de-5cd5fbca57cc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:48.881585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:48.896946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] MFA Rules not processed for user `9f4b21f022f34ff8bb72f8f88caa148d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:48.899166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:48.967062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:48.968216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:48.968611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:48.969110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:48.970403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:48.972390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:48.987085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 979/1962] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:48.991516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:48.997995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 984/1963] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:49.009123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9e08f-67bf-4983-ad70-0d253b636940 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.015146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.015748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.016024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.016295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.017025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.018754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.028121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.030353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:49.039222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 980/1964] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:49.040368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.051812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a08014-ac9f-4a9d-892c-bf3922634042 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.057513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.058172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.058479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.058729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] PATH_INFO: `/v3/projects/c9f9e16aa95146229d03b4bd6eab200a/users/e002f4e1b40f44bcbf5a6c63e3dbd7da/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.076278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9e16aa95146229d03b4bd6eab200a, user_id=e002f4e1b40f44bcbf5a6c63e3dbd7da, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.079241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991dcac-2fc8-41b9-b0bb-e1489b845906 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.097155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 981/1965] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:49 2022] PUT /identity/v3/projects/c9f9e16aa95146229d03b4bd6eab200a/users/e002f4e1b40f44bcbf5a6c63e3dbd7da/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:49.115339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.117244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.117426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.126759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725ab0-902c-4f4f-9b7c-74357efadafd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.159141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] MFA Rules not processed for user `e002f4e1b40f44bcbf5a6c63e3dbd7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:49.160437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:49.195461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:49.201330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.201997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.202236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.202588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.266252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 982/1966] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:49.267496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.268941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:49.284309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10008d-3243-4a8e-908a-29f644d8a90e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.289719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.290427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.290920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.291276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.293291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:49.312415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.314024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.326986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 985/1967] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:49.327837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.340230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:49.410199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.412032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.425008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 983/1968] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:49.435916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e24947-2e52-4070-a0b1-bcf61999a18b service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.443414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.444245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.444667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.445169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.445933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.448077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.503100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 986/1969] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:49 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:49.508331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.521611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907f2fd-a846-431c-95c5-f7db61f4152a service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.595032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.595769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.596061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.596386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.597813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.601092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.635281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 984/1970] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:49 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:49.636904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.648794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52036385-dd54-42b6-b816-67413aa657da admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.660114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.660779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.661760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.662314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.663007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.664721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.679376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 987/1971] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:49.680574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.696802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f309882-6183-4b17-9ecd-52186a5f7d49 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.702271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.702913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.703194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.703468 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.704127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.706021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497b907-5a7e-4142-aa5e-37da15b0b8e0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.723454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 985/1972] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:49.727817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:49.738332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0472e9d-0873-464a-864f-f2b3f7d0b802 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:49.745599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:49.746446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.746683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.746969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] PATH_INFO: `/v3/projects/5ed95bdae4e74509ba2e8afbfbb8976e/users/0a420762cda4476a83fed1af57210f13/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.768162 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed95bdae4e74509ba2e8afbfbb8976e, user_id=0a420762cda4476a83fed1af57210f13, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:49.772265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:49.808399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 988/1973] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:49 2022] PUT /identity/v3/projects/5ed95bdae4e74509ba2e8afbfbb8976e/users/0a420762cda4476a83fed1af57210f13/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:49.818677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:49.819219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:49.819626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:49.876086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] MFA Rules not processed for user `0a420762cda4476a83fed1af57210f13`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:49.877850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:49.924993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:49.985638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 986/1974] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:49.986954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.123596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01826f03-ea70-4b73-b368-c5c7253fa14e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.145121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.146757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.147046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.147646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.148347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.150310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.194064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 989/1975] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:49 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:50.198391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.212875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904372-8d2e-46d1-8a94-7bad4e2af42a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.305875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.306702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.307053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.310886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.312047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.312975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.314522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.316176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.342504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530088d-db81-481d-8334-a692b3711c07 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.349267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.350374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.350736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.351124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] PATH_INFO: `/v3/users/75a13a8eb00043afa75379a4a6fd9334` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.352730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a13a8eb00043afa75379a4a6fd9334)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.354780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.356437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 987/1976] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:50 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:50.361004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.375674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a3e5a-f072-44f4-82b6-fcaa1b64f7b0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.383868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.384707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.385204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.385364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.385984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.387807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.401167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 988/1977] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:50.405917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.409963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:50.423149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a13a8eb00043afa75379a4a6fd9334'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:50.423943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131af2-3e3e-45d7-a7e2-7ac79d735261 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.430438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.431036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.431349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.431677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] PATH_INFO: `/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0/users/7e8f1fe7aab9490d90cb4c76470a74b9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.436849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a13a8eb00043afa75379a4a6fd9334'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:50.437526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a13a8eb00043afa75379a4a6fd9334'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:50.438243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a13a8eb00043afa75379a4a6fd9334'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:50.447410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a2415f6-f837-4e85-afaa-fe4b2edd6f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a13a8eb00043afa75379a4a6fd9334'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:50.468319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4a0f80de0046c5b24024ea5ef7ace0, user_id=7e8f1fe7aab9490d90cb4c76470a74b9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.475996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 990/1978] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:50 2022] DELETE /identity/v3/users/75a13a8eb00043afa75379a4a6fd9334 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:50.478465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.479288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.480297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.482799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.501752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:50.503024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.504094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 989/1979] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:50 2022] PUT /identity/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0/users/7e8f1fe7aab9490d90cb4c76470a74b9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:50.508308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.510090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.574024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 991/1980] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:50.587378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.588848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.603294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847db9-bf9b-4261-b204-3b07b5c1c37f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.609215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.609953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.610156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.610427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.611080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.612953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.624878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 990/1981] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:50.628916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.656940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7f3f9-a923-4bb5-a370-efe43cffbec1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.668813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.669872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.672043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.672340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] PATH_INFO: `/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0/users/7e8f1fe7aab9490d90cb4c76470a74b9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.678756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4a0f80de0046c5b24024ea5ef7ace0, user_id=7e8f1fe7aab9490d90cb4c76470a74b9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.685502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bff372-53b5-4e6e-b2f4-4f37c20196f0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.702312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 991/1982] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:50 2022] PUT /identity/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0/users/7e8f1fe7aab9490d90cb4c76470a74b9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:50.703536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79882ac2-8199-4314-8bc0-421d2947e490 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.713576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.713892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.714129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.736772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:50.750357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] MFA Rules not processed for user `7e8f1fe7aab9490d90cb4c76470a74b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:50.754162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.774058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.775157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.775157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.775517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.811751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:50.840394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 992/1983] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:50.855353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:50.857745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:50.858774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.860368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.871725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 992/1984] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:50.930713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5d04-c7ab-414c-9ef2-c76d36cd14bb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:50.941213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:50.941999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:50.942886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:50.943324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:50.954767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:50.956783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:50.976802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 993/1985] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:51.021590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:51.023312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:51.051146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e28a1-25ac-4c89-b21f-bb96421c6154 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:51.061427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:51.062411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:51.062661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:51.063306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:51.065144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:51.192228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:51.196713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:51.228884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 993/1986] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:51.268323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:51.269810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:51.298737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71faa-b7c0-46d8-967b-54939c274492 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:51.305778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:51.306424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:51.306714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:51.308305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] PATH_INFO: `/v3/projects/66c0ba953e1a4486b7ec3652a80a5983` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:51.309454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c0ba953e1a4486b7ec3652a80a5983)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:51.311361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:51.370525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c0ba953e1a4486b7ec3652a80a5983', 'request_id': 'req-1e1a6be0-5262-4988-9894-e8b4ff3cfead'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.377461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c0ba953e1a4486b7ec3652a80a5983', 'request_id': 'req-1e1a6be0-5262-4988-9894-e8b4ff3cfead'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.389865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c0ba953e1a4486b7ec3652a80a5983', 'request_id': 'req-1e1a6be0-5262-4988-9894-e8b4ff3cfead'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.405845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] The token cache is being invalidate because project 66c0ba953e1a4486b7ec3652a80a5983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:51.406148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.406937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.420332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 994/1987] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:51 2022] DELETE /identity/v3/projects/66c0ba953e1a4486b7ec3652a80a5983 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:51.425312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:51.465175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1f123-8965-4ed0-a5fd-217139439734 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:51.552474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:51.553253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:51.553542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:51.553809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] PATH_INFO: `/v3/users/8ab9bd3331cc4d018b0daacb9259d849` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:51.554947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab9bd3331cc4d018b0daacb9259d849)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:51.556898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:51.625633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab9bd3331cc4d018b0daacb9259d849'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.635556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab9bd3331cc4d018b0daacb9259d849'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.636243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab9bd3331cc4d018b0daacb9259d849'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.636994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab9bd3331cc4d018b0daacb9259d849'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.648590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90370d70-8588-4d83-a867-3feb324653d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab9bd3331cc4d018b0daacb9259d849'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:51.651371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:51.673229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 994/1988] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:51 2022] DELETE /identity/v3/users/8ab9bd3331cc4d018b0daacb9259d849 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:52.249440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:52.251160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.274719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a6be0-5262-4988-9894-e8b4ff3cfead admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:52.297170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:52.353284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:52.353927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.354214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.354492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] PATH_INFO: `/v3/projects/7fc3227ab645439e823e183f5a583519` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.355931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc3227ab645439e823e183f5a583519)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:52.357957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:52.416944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc3227ab645439e823e183f5a583519', 'request_id': 'req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.424108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc3227ab645439e823e183f5a583519', 'request_id': 'req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.432269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc3227ab645439e823e183f5a583519', 'request_id': 'req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.449152 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] The token cache is being invalidate because project 7fc3227ab645439e823e183f5a583519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:52.449516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.450316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.452307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 995/1989] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:52 2022] DELETE /identity/v3/projects/7fc3227ab645439e823e183f5a583519 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:52.464807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad39bd-b26f-4676-9e0f-06a4898aa2bc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.465330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad39bd-b26f-4676-9e0f-06a4898aa2bc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.466286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad39bd-b26f-4676-9e0f-06a4898aa2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.494645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9fad39bd-b26f-4676-9e0f-06a4898aa2bc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:52.496027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9fad39bd-b26f-4676-9e0f-06a4898aa2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.528575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:52.530212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.617056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 995/1990] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:52.624931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.625639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.626562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.642015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab39a9-fe9d-4662-bf8c-eb0df6bcdfca admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:52.652299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:52.653155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.653502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.653963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] PATH_INFO: `/v3/users/b2f3d6f48ca34b23a1b65fbaf2717b11` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.659631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f3d6f48ca34b23a1b65fbaf2717b11)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:52.676431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:52.678655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.680955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:52.704735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 996/1991] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:52.709814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:52.725675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd26b-9abd-4031-bd04-2b7ee5053ae7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:52.732237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:52.733325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.733621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.733944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.734610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:52.734967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:52.737141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:52.760220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 997/1992] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:52.762151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:52.782797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8f7b2-a8bd-4972-a8d7-7b50173501dc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:52.790061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f3d6f48ca34b23a1b65fbaf2717b11'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.797724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:52.798343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.798624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.798893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.799516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:52.801306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:52.803241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:52.824300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f3d6f48ca34b23a1b65fbaf2717b11'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.834049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f3d6f48ca34b23a1b65fbaf2717b11'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.835012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f3d6f48ca34b23a1b65fbaf2717b11'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.836323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-72aaa18b-9c9c-485f-bcab-6b59e540aba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f3d6f48ca34b23a1b65fbaf2717b11'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:52.861851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 996/1993] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:52 2022] DELETE /identity/v3/users/b2f3d6f48ca34b23a1b65fbaf2717b11 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:52.870119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.870852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.871988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.885884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 998/1994] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:52 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:52.889542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:52.892883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.893565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:52.894992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:52.983240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f0eb6-7cf6-4ac0-98d1-3bc04bfc4888 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:52.988631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 997/1995] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:52.995464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:52.996569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:52.996569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:52.997008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:52.997744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.000296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.003521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.017215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:53.037333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 999/1996] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:52 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:53.043682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.081103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509ac66-691a-4a67-b043-a8e20b7e8f2b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.106805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.108862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.109358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.109845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.110671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.112969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.140224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1000/1997] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:53.157838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.179274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527abe9-4bdd-48ab-a1b0-447c1fc10228 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.200369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc2924-043e-4434-bdfc-e86c5d63fc42 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.204925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.207495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.209774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.210331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.211374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.213645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.215234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.215868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.216168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.216741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.230720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1001/1998] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:53.234728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.244158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.244158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6930e-649a-4b4e-9543-f936bf607279 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.254842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 998/1999] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:53.272110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf59d-c6a8-487e-badc-23869c5a95da admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.280751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.280751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.280751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.280751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] PATH_INFO: `/v3/projects/c8e981d8854f460b9cc679d10898fc34/users/c486fe5cdb9c43db902a6984791b05f2/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.292421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:53.299281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e981d8854f460b9cc679d10898fc34, user_id=c486fe5cdb9c43db902a6984791b05f2, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.303695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.327466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1002/2000] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:53 2022] PUT /identity/v3/projects/c8e981d8854f460b9cc679d10898fc34/users/c486fe5cdb9c43db902a6984791b05f2/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:53.341799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.343055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.343562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.400655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] MFA Rules not processed for user `c486fe5cdb9c43db902a6984791b05f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:53.404943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:53.496120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 999/2001] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:53.500885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.622450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eecc7f-b363-4f9c-9b16-dcb4a034d11f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.628540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.629467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.629876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.630244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.631129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.633877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.654957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.656689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:53.668217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:53.680006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29a4e-367c-4d09-b1a2-7a9f1156c61b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.683129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1003/2002] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:53 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:53.693678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.714950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.718823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.719400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.719968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] PATH_INFO: `/v3/projects/eaa347b0bc474cf5a7fcde923ed3285c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.726288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa347b0bc474cf5a7fcde923ed3285c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.732298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.787627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ef077-9106-4a3d-ae77-222199bea774 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.805597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.807146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.807462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.809311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:53.810000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:53.812257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:53.828189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa347b0bc474cf5a7fcde923ed3285c', 'request_id': 'req-59639546-1fbb-4d91-92cb-8575ff6a3190'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:53.838057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa347b0bc474cf5a7fcde923ed3285c', 'request_id': 'req-59639546-1fbb-4d91-92cb-8575ff6a3190'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:53.845724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa347b0bc474cf5a7fcde923ed3285c', 'request_id': 'req-59639546-1fbb-4d91-92cb-8575ff6a3190'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:53.846879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1004/2003] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:53 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:53.851532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.866178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94db75-006f-4ed9-89d3-d53f044032f3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.872571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] The token cache is being invalidate because project eaa347b0bc474cf5a7fcde923ed3285c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:53.872696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:53.873383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:53.875025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1000/2004] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:53 2022] DELETE /identity/v3/projects/eaa347b0bc474cf5a7fcde923ed3285c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:53.878824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:53.880757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:53.986677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:53.991012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59639546-1fbb-4d91-92cb-8575ff6a3190 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:53.998031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:53.998562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:53.998897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:53.999418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.000092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.000392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.000822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.001103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.001372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] PATH_INFO: `/v3/users/5cb94fcdc8204d15951ec4f9a770fb5e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.002136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.002636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cb94fcdc8204d15951ec4f9a770fb5e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.005456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.023238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1005/2005] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:54.024821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.028846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.049725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40eee-c732-4237-80ef-d4e87369a403 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.057779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.058547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.058902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.059245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] PATH_INFO: `/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0/users/0d4d12bab6a1434b9c0049e17dbe9e16/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.078722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3ec784a4a443c6a7309b2a4e28e0e0, user_id=0d4d12bab6a1434b9c0049e17dbe9e16, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.082010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.082247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cb94fcdc8204d15951ec4f9a770fb5e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.106512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1006/2006] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:54 2022] PUT /identity/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0/users/0d4d12bab6a1434b9c0049e17dbe9e16/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:54.110771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.112201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cb94fcdc8204d15951ec4f9a770fb5e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.124883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cb94fcdc8204d15951ec4f9a770fb5e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.125725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cb94fcdc8204d15951ec4f9a770fb5e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.126423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cb94fcdc8204d15951ec4f9a770fb5e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.142018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1001/2007] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:53 2022] DELETE /identity/v3/users/5cb94fcdc8204d15951ec4f9a770fb5e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:54.204762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a48db8-7164-4faa-9018-6a26de4351f4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.280559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.281888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.282211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.282560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.283337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.285080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f243093-567e-48b6-89c8-9ff8b7692654 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.301387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1007/2008] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:54.307485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.309609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.325820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:54.333507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60feabd-3bff-48d0-959b-1d63a6b3d1ee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.349646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.350497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.350844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.351189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] PATH_INFO: `/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0/users/0d4d12bab6a1434b9c0049e17dbe9e16/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.353437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3ec784a4a443c6a7309b2a4e28e0e0, user_id=0d4d12bab6a1434b9c0049e17dbe9e16, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.357934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.370409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1002/2009] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:54 2022] PUT /identity/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0/users/0d4d12bab6a1434b9c0049e17dbe9e16/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:54.382987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.383274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.383555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.419135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] MFA Rules not processed for user `0d4d12bab6a1434b9c0049e17dbe9e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:54.419920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.541040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:54.556313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1008/2010] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:54.574032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.577934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.626423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.628262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.664039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6827481-5f99-4a6f-b240-35d22267419f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.668529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.669227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.669565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.669899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.672007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.766630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5782cd-5700-4734-88fc-08e3e38c0bc3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.775297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.776571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.776797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.777165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] PATH_INFO: `/v3/projects/d44b77a448434ad9afe19227dfa8c962` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.779046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44b77a448434ad9afe19227dfa8c962)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.781848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.815504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.819285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:54.837466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1003/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:54.862802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.863704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.875500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44b77a448434ad9afe19227dfa8c962', 'request_id': 'req-742a6579-0743-45d9-8769-548bde0b52ef'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.881506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe6b0d-049e-409d-b8e9-14b35eb33b39 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:54.882568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44b77a448434ad9afe19227dfa8c962', 'request_id': 'req-742a6579-0743-45d9-8769-548bde0b52ef'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.893334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44b77a448434ad9afe19227dfa8c962', 'request_id': 'req-742a6579-0743-45d9-8769-548bde0b52ef'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.913494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] The token cache is being invalidate because project d44b77a448434ad9afe19227dfa8c962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:54.913908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.915605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:54.917793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1009/2012] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:54 2022] DELETE /identity/v3/projects/d44b77a448434ad9afe19227dfa8c962 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:54.921731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:54.923562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:54.975650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:54.976518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:54.976918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:54.977297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] PATH_INFO: `/v3/users/e002f4e1b40f44bcbf5a6c63e3dbd7da` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:54.978559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e002f4e1b40f44bcbf5a6c63e3dbd7da)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:54.980615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.006204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a6579-0743-45d9-8769-548bde0b52ef admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.014041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.014715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.015094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.015325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] PATH_INFO: `/v3/users/c44e09a4c2ca4d4aacfcf3d5b69889dd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.017459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44e09a4c2ca4d4aacfcf3d5b69889dd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.019611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.050148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e002f4e1b40f44bcbf5a6c63e3dbd7da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.051587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:55.073723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:55.084226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e002f4e1b40f44bcbf5a6c63e3dbd7da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.092519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44e09a4c2ca4d4aacfcf3d5b69889dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.093490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e002f4e1b40f44bcbf5a6c63e3dbd7da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.094557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e002f4e1b40f44bcbf5a6c63e3dbd7da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.095464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-359a45c8-5ce1-4d73-accf-4683408362f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e002f4e1b40f44bcbf5a6c63e3dbd7da'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.102795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44e09a4c2ca4d4aacfcf3d5b69889dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.103779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44e09a4c2ca4d4aacfcf3d5b69889dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.105045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44e09a4c2ca4d4aacfcf3d5b69889dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.120668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44e09a4c2ca4d4aacfcf3d5b69889dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.123824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1004/2013] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:54 2022] DELETE /identity/v3/users/e002f4e1b40f44bcbf5a6c63e3dbd7da => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:55.129095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.129941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.130536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.154577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1010/2014] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:54 2022] DELETE /identity/v3/users/c44e09a4c2ca4d4aacfcf3d5b69889dd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:55.154733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:55.156014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.288301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1005/2015] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:55.299622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.301163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.366331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23384-da16-4ab6-9aef-41e536122c8d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.370161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.370787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.371073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.371347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.381785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.383346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b366162-3e77-4e7b-b6f4-bea18ed14aff service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.393334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1011/2016] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:55.514653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.516335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.530700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7820-ddf9-4663-8fa8-0a0e1742bb0d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.544828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.545596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.545923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.546204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] PATH_INFO: `/v3/projects/498b09339dc54f62b12dc8681e68a413` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.549279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498b09339dc54f62b12dc8681e68a413)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.551230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.607962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498b09339dc54f62b12dc8681e68a413', 'request_id': 'req-354cd78f-3687-479e-84ff-fcdc52d88691'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.617762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498b09339dc54f62b12dc8681e68a413', 'request_id': 'req-354cd78f-3687-479e-84ff-fcdc52d88691'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.625014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498b09339dc54f62b12dc8681e68a413', 'request_id': 'req-354cd78f-3687-479e-84ff-fcdc52d88691'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.643985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] The token cache is being invalidate because project 498b09339dc54f62b12dc8681e68a413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:55.644368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.645230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-354cd78f-3687-479e-84ff-fcdc52d88691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.648531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1006/2017] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:55 2022] DELETE /identity/v3/projects/498b09339dc54f62b12dc8681e68a413 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:55.654271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.654778 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.654867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.679318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:55.680469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.752801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1012/2018] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:55.764472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.764796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.765228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.772412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.773913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.786508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811f6d2-f633-4ce3-8a1f-54664f363d7c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.791571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.792216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.792522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.792945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] PATH_INFO: `/v3/projects/c9f9e16aa95146229d03b4bd6eab200a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.794086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f9e16aa95146229d03b4bd6eab200a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.795300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:55.796404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.796539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.806879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1007/2019] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:55.810858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.821374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23cb0-3740-423c-b8d9-18b6e027906a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.826774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.827376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.827663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.828004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.828822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:55.829183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.831334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.844247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1008/2020] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:55.847852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:55.849163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.851708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f9e16aa95146229d03b4bd6eab200a', 'request_id': 'req-5dc2eecb-2a77-4991-b638-e221a43f6de2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.858768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f9e16aa95146229d03b4bd6eab200a', 'request_id': 'req-5dc2eecb-2a77-4991-b638-e221a43f6de2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.860516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f540e8-54ec-4c11-af91-22de22b1454a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.867569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f9e16aa95146229d03b4bd6eab200a', 'request_id': 'req-5dc2eecb-2a77-4991-b638-e221a43f6de2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.880732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] The token cache is being invalidate because project c9f9e16aa95146229d03b4bd6eab200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:55.881027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.881782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:55.883538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1013/2021] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:55 2022] DELETE /identity/v3/projects/c9f9e16aa95146229d03b4bd6eab200a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:55.887469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.888857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:55.889811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:55.924331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:55.925172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:55.925401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:55.925675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:55.926406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:55.928847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:55.960366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2eecb-2a77-4991-b638-e221a43f6de2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:55.961122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1009/2022] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:55 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:55.965250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:55.966937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.025871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.026535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.026864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.027083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] PATH_INFO: `/v3/users/0a420762cda4476a83fed1af57210f13` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.028216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a420762cda4476a83fed1af57210f13)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.030347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.033571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67357f5-a7b8-42b9-a2f0-993043f7a5be admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.039223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.039833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.040117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.040393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.041064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.043493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.067486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1010/2023] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:55 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:56.071566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.083187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249243d-4cf9-4474-ba76-09d2dbc8cd31 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.084268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a420762cda4476a83fed1af57210f13'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.088513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.089190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.089477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.089721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.090397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.092541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.093123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a420762cda4476a83fed1af57210f13'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.093954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a420762cda4476a83fed1af57210f13'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.094746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a420762cda4476a83fed1af57210f13'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.103246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1011/2024] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:56.106432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a420762cda4476a83fed1af57210f13'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.107143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.109762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.125207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230682bd-65f4-4da0-ae2a-39c48c256a5a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.125800 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:56.127466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1014/2025] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:55 2022] DELETE /identity/v3/users/0a420762cda4476a83fed1af57210f13 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:56.213265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.214239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.214567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.214912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.216321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.218227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3dbf-a1f8-42c7-ac1d-a9da02f4b1f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.232283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1012/2026] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:56.236497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.248690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c563-9235-47e3-8a4e-81b207a0acfc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.255301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.256360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.256684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.257369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] PATH_INFO: `/v3/projects/8ab992b8bb69431bb266079ff5ebf1f3/users/5322903880e042e588a232a6869f173a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.281948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab992b8bb69431bb266079ff5ebf1f3, user_id=5322903880e042e588a232a6869f173a, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.285390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.316526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1015/2027] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:56 2022] PUT /identity/v3/projects/8ab992b8bb69431bb266079ff5ebf1f3/users/5322903880e042e588a232a6869f173a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:56.326032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.326321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.326715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.349450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.351688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.375017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] MFA Rules not processed for user `5322903880e042e588a232a6869f173a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:56.376658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.397777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:56.446754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965094-c654-4ad1-92cc-967c6d733e81 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.451828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.452549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.453078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.453495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.455665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.473430 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1013/2028] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:56.475225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.554403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.555870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.563255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3189735-f91d-4c57-bb8a-2f9503425411 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.566532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1016/2029] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:56.567281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.568867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.569917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.570878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.571256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.571673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.572408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.576516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.582551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ad49d-8727-4592-8bf7-fbd021e73e63 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.589330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.589996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.590277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.590551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] PATH_INFO: `/v3/projects/5ed95bdae4e74509ba2e8afbfbb8976e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.591672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed95bdae4e74509ba2e8afbfbb8976e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.593633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.614278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1014/2030] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:56 2022] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:56.615504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.690825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed95bdae4e74509ba2e8afbfbb8976e', 'request_id': 'req-c3946a7b-0d3e-47c8-88df-288cf2c894d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.692674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed95bdae4e74509ba2e8afbfbb8976e', 'request_id': 'req-c3946a7b-0d3e-47c8-88df-288cf2c894d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.704861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed95bdae4e74509ba2e8afbfbb8976e', 'request_id': 'req-c3946a7b-0d3e-47c8-88df-288cf2c894d8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.720751 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] The token cache is being invalidate because project 5ed95bdae4e74509ba2e8afbfbb8976e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:56.721172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.722395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.725334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1017/2031] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:56 2022] DELETE /identity/v3/projects/5ed95bdae4e74509ba2e8afbfbb8976e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:56.729550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.731311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.745351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad18c4e-a57b-475e-a821-e35cb8f8fe31 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.747998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:56.822552 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:56.834692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.835452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.835731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.836005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.836327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946a7b-0d3e-47c8-88df-288cf2c894d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.836662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.838556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.841261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.841975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.842266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.842547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] PATH_INFO: `/v3/users/7e8f1fe7aab9490d90cb4c76470a74b9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.843709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8f1fe7aab9490d90cb4c76470a74b9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.846115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.864825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1015/2032] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:56 2022] POST /identity/v3/users => generated 307 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:03:56.869031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.870696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:56.883255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524fc1e-3e3d-4963-bf5b-d1fd7d4b6207 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.889122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.889413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.889939 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.890084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.890714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.892461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.904807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1016/2033] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:03:56.909088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.911897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8f1fe7aab9490d90cb4c76470a74b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.920434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3697bb-0736-4464-a8b2-6e29a570a771 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:56.924518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8f1fe7aab9490d90cb4c76470a74b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.925437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8f1fe7aab9490d90cb4c76470a74b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.926402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8f1fe7aab9490d90cb4c76470a74b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.927750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:56.929318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:56.929318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:56.929318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] PATH_INFO: `/v3/projects/b0ca999479a042f79cf61eac3709addb/users/e22848bd33e14a6c8d2c53af8757585c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:56.935883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8f1fe7aab9490d90cb4c76470a74b9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:56.948563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ca999479a042f79cf61eac3709addb, user_id=e22848bd33e14a6c8d2c53af8757585c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:56.951726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:56.959320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1018/2034] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:56 2022] DELETE /identity/v3/users/7e8f1fe7aab9490d90cb4c76470a74b9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:56.975206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1017/2035] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:56 2022] PUT /identity/v3/projects/b0ca999479a042f79cf61eac3709addb/users/e22848bd33e14a6c8d2c53af8757585c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:56.980968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:56.982862 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.072860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af834ca-0057-4ad6-bf71-8d7edd9eef66 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.109456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:57.135750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.136358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.136672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.136950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.137598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.139204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b629a-4324-45e7-b0a6-0de43727b481 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.154157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1019/2036] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:57.158067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.170181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429084f-1762-4f28-8d04-147e1cb94db2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.174746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.175388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.175663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.175932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] PATH_INFO: `/v3/projects/b0ca999479a042f79cf61eac3709addb/users/e22848bd33e14a6c8d2c53af8757585c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.178866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ca999479a042f79cf61eac3709addb, user_id=e22848bd33e14a6c8d2c53af8757585c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.181769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.192998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1018/2037] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:57 2022] PUT /identity/v3/projects/b0ca999479a042f79cf61eac3709addb/users/e22848bd33e14a6c8d2c53af8757585c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:57.203223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.203585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.203937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.234072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] MFA Rules not processed for user `e22848bd33e14a6c8d2c53af8757585c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:57.235427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.287004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.288973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.332414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1020/2038] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:57.344812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.346222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.376780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88869782-8f87-4463-8ff0-4c2b080bd388 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.382606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.383275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.383565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.383828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] PATH_INFO: `/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.385006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4a0f80de0046c5b24024ea5ef7ace0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.387567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.409278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07354522-141d-4d70-b1f2-a10a64933871 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.417400 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.418232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.418551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.418949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.430457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.431981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e6c3a-72cb-41c6-83b2-4e292aad96e4 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.443075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4a0f80de0046c5b24024ea5ef7ace0', 'request_id': 'req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:57.443654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1021/2039] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:57.449275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4a0f80de0046c5b24024ea5ef7ace0', 'request_id': 'req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:57.456913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4a0f80de0046c5b24024ea5ef7ace0', 'request_id': 'req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:57.471590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] The token cache is being invalidate because project 8c4a0f80de0046c5b24024ea5ef7ace0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:57.471956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:57.472701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:57.475057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1019/2040] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:57 2022] DELETE /identity/v3/projects/8c4a0f80de0046c5b24024ea5ef7ace0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:03:57.480998 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd860f-7026-4b8c-bca2-9bb88b7bacdf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.481370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd860f-7026-4b8c-bca2-9bb88b7bacdf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.481654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd860f-7026-4b8c-bca2-9bb88b7bacdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.504107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4dd860f-7026-4b8c-bca2-9bb88b7bacdf None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:57.506586 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4dd860f-7026-4b8c-bca2-9bb88b7bacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.530583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.532172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.562440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:57.566062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:57.577140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1022/2041] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:57.587729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.587941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.588223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.602728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498489b7-a6c4-4a2f-8ea9-b17b7f23e7ac admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.606408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.607011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.607308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.607580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.608129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:57.609355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.609486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:57.618159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1023/2042] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:03:57.623572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.634414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ebdb38-e51a-4dbf-9ab4-d4262eb4fe7c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.640576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.641199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.641478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.641750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.642403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:57.642706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.644310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.657613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1024/2043] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:03:57.662409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.673440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef08ac9-bfeb-4aee-b90c-fea65e744785 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.678782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.679480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.680193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.680454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.681206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.683217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.695730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.697221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.707489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1020/2044] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:57.716534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1025/2045] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:57 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:57.720947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.732218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0e0d-595b-461b-9fc2-e325c0a414d3 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.804723 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.805389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.805710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.806053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.806710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.808838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.837235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1021/2046] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:03:57 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:03:57.841529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.852951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e1c1-0481-490c-8d76-69d0a7408ff2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.858311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.859151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.859469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.859769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.860580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.862189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.875923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1026/2047] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:57.880687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.897935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98bda-758a-4016-9c3c-0d91c1dcfdde admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.905339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.906724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.907209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.907832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.908831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.911483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e3d9-61f6-46a0-bc2f-66e9ee04524c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:57.930886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1022/2048] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:03:57.935075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:57.957035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fea78a-c4f4-4e98-be68-07e796a8efb1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:57.963026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371507-e528-482d-998c-706f394c479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:57.963785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371507-e528-482d-998c-706f394c479d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:57.964075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371507-e528-482d-998c-706f394c479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:57.964352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371507-e528-482d-998c-706f394c479d admin admin] PATH_INFO: `/v3/projects/bfc945af814247b3bfe320288ea9d38a/users/c6be57f945a74f479bb118718b084a82/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:57.988419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4371507-e528-482d-998c-706f394c479d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc945af814247b3bfe320288ea9d38a, user_id=c6be57f945a74f479bb118718b084a82, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:57.992765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4371507-e528-482d-998c-706f394c479d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:58.033787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1027/2049] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:03:57 2022] PUT /identity/v3/projects/bfc945af814247b3bfe320288ea9d38a/users/c6be57f945a74f479bb118718b084a82/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:58.047013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:58.047293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:58.047627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:58.108731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] MFA Rules not processed for user `c6be57f945a74f479bb118718b084a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:58.111835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:58.197819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:58.242286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1023/2050] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:58.243765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371507-e528-482d-998c-706f394c479d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:58.306262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371507-e528-482d-998c-706f394c479d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:58.311536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:58.312408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:58.312872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:58.313308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:58.323522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:58.325104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc9e-6093-4229-bd46-be5699a94c1f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:58.337024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1028/2051] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:03:58.360949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:58.446268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ac3f-fbc3-4414-ba41-5ba21806bca2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:58.452614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:58.453357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:58.453717 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:58.454068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] PATH_INFO: `/v3/users/c6be57f945a74f479bb118718b084a82` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:58.455584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6be57f945a74f479bb118718b084a82)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:58.457612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:58.546298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6be57f945a74f479bb118718b084a82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:58.570005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6be57f945a74f479bb118718b084a82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:58.579085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6be57f945a74f479bb118718b084a82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:58.580103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6be57f945a74f479bb118718b084a82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:58.580841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6be57f945a74f479bb118718b084a82'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:58.600432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1024/2052] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:03:58 2022] DELETE /identity/v3/users/c6be57f945a74f479bb118718b084a82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:58.602031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:58.602321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:58.602595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:58.624211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:58.625467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:58.713210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1029/2053] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:58.732314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:58.734097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:58.800871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec20f94-b88c-426e-8912-aabf84d80e1a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:58.805472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:58.806081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:58.806365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:58.806635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:58.815992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:58.818237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b191ee8-f5ae-4ddd-95ca-715eec6dcbdb service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:58.828153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1025/2054] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:03:59.545348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:59.546810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:59.561490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aab92-11b5-4f0d-9594-35900ce03dd1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:59.579664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:59.580360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:59.582966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:59.583327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] PATH_INFO: `/v3/projects/bfc945af814247b3bfe320288ea9d38a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:59.584921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc945af814247b3bfe320288ea9d38a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:59.587328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:59.618099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:59.662974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc945af814247b3bfe320288ea9d38a', 'request_id': 'req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:59.671432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc945af814247b3bfe320288ea9d38a', 'request_id': 'req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:59.691158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc945af814247b3bfe320288ea9d38a', 'request_id': 'req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:59.698834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] The token cache is being invalidate because project bfc945af814247b3bfe320288ea9d38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:03:59.699209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:59.699993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-209e876a-d7df-4ab1-89f8-9aa7fd2ab627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:03:59.701630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1030/2055] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:03:59 2022] DELETE /identity/v3/projects/bfc945af814247b3bfe320288ea9d38a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:03:59.708789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:59.709116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:59.709387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:59.725104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:03:59.753260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:59.755380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:59.870266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1026/2056] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:59.880723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:59.882377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:59.882896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:59.918078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:03:59.919310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:03:59.927634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1031/2057] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:03:59.931856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:59.941311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf73fab-2682-438a-a5cc-0036e21188ec None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:59.946524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:59.947179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:59.947386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:59.947655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:59.948302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:03:59.948635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:59.950215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:03:59.966080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1027/2058] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:03:59.967198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:03:59.976454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d09603-5765-4cef-8e82-8ef83d130a3e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:03:59.981260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:03:59.981853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:03:59.982135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:03:59.982437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:03:59.983058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:03:59.984994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.012919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1032/2059] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:03:59 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:00.017136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:00.027544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd494-619d-4aed-9359-38461ce84367 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:00.084827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:00.085519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.085801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.086070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.086692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:00.088602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.109632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1028/2060] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:00 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:00.113982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:00.124450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f6dfc-b8f8-4d1d-aea1-298496ff8e7b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:00.129123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:00.129921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.130205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.130474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.131109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:00.132811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.142492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1033/2061] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:00.147089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:00.157227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd845a-b252-4902-a571-0e1823812151 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:00.162969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:00.163527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.163825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.164056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.164802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:00.166525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5d014-824d-4f76-8841-5b0bdd8eb46b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.177301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1029/2062] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:00.181448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:00.192237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a54802-8243-4866-aef1-e9206119c46d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:00.197001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:00.197650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.197939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.198223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] PATH_INFO: `/v3/projects/51182debcc284221aade6594719febc6/users/f6b4977ff00841399906870d9314ea02/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.213816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51182debcc284221aade6594719febc6, user_id=f6b4977ff00841399906870d9314ea02, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:00.217072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.238167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1034/2063] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:00 2022] PUT /identity/v3/projects/51182debcc284221aade6594719febc6/users/f6b4977ff00841399906870d9314ea02/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:00.249773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.250539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.250823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.282177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] MFA Rules not processed for user `f6b4977ff00841399906870d9314ea02`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:00.283918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:00.356985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1030/2064] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:00.369688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:00.371374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:00.453752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acd72-fba1-46b2-bde2-b6e9943c4e87 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:00.458020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:00.458917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:00.459528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:00.459810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:00.469066 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:00.470926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00fe54-842f-455e-9743-cf4a2e18f21c service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:00.483652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1035/2065] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:01.111560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:01.113632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:01.123827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:01.201546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68490df-02e9-48f8-8f35-3eb39c9a2962 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:01.208707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:01.209598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:01.210019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:01.210302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] PATH_INFO: `/v3/users/c486fe5cdb9c43db902a6984791b05f2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:01.212763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c486fe5cdb9c43db902a6984791b05f2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:01.214695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:01.262529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c486fe5cdb9c43db902a6984791b05f2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.275131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c486fe5cdb9c43db902a6984791b05f2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.281862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c486fe5cdb9c43db902a6984791b05f2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.282530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c486fe5cdb9c43db902a6984791b05f2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.283133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c486fe5cdb9c43db902a6984791b05f2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.295894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1031/2066] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:01 2022] DELETE /identity/v3/users/c486fe5cdb9c43db902a6984791b05f2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:01.300432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:01.300963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:01.301056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:01.323607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:01.325685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:01.361098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:01.393241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1036/2067] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:01.403529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:01.405048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:01.465427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45cb1-3677-499a-9950-9c157a8a10db admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:01.469219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:01.469822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:01.470100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:01.470423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:01.480361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:01.482044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:01.493785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1032/2068] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:01.785331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:01.787486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:01.801610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee9fb9-07aa-482a-a6c3-3f956a048a97 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:01.818170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:01.818828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:01.819109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:01.819382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] PATH_INFO: `/v3/projects/c8e981d8854f460b9cc679d10898fc34` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:01.820602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e981d8854f460b9cc679d10898fc34)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:01.822535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:01.877291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e981d8854f460b9cc679d10898fc34', 'request_id': 'req-05218c29-1afa-4c97-ac46-8c54d924ce52'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.883416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e981d8854f460b9cc679d10898fc34', 'request_id': 'req-05218c29-1afa-4c97-ac46-8c54d924ce52'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.890816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e981d8854f460b9cc679d10898fc34', 'request_id': 'req-05218c29-1afa-4c97-ac46-8c54d924ce52'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.902503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] The token cache is being invalidate because project c8e981d8854f460b9cc679d10898fc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:01.902791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.903424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:01.904974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1037/2069] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:01 2022] DELETE /identity/v3/projects/c8e981d8854f460b9cc679d10898fc34 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:01.909404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:01.918973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba1eb2-7992-4311-b35a-d573dbf87d18 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:01.939887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:01.981611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:01.982235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:01.982516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:01.982791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] PATH_INFO: `/v3/users/0d4d12bab6a1434b9c0049e17dbe9e16` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:01.983936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4d12bab6a1434b9c0049e17dbe9e16)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:01.985972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.036727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4d12bab6a1434b9c0049e17dbe9e16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.049713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4d12bab6a1434b9c0049e17dbe9e16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.063429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4d12bab6a1434b9c0049e17dbe9e16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.063429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4d12bab6a1434b9c0049e17dbe9e16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.063429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4d12bab6a1434b9c0049e17dbe9e16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.073529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1033/2070] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:01 2022] DELETE /identity/v3/users/0d4d12bab6a1434b9c0049e17dbe9e16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:02.467713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:02.470231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.499185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05218c29-1afa-4c97-ac46-8c54d924ce52 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:02.527469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:02.529241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.587065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:02.587696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.587976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.588245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] PATH_INFO: `/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.589681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3ec784a4a443c6a7309b2a4e28e0e0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:02.591753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.629984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a6cd9-4343-445a-a4f2-88ee94b7489c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:02.636535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:02.637228 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.637465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.637738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] PATH_INFO: `/v3/users/5322903880e042e588a232a6869f173a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.638902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5322903880e042e588a232a6869f173a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:02.641333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.659818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3ec784a4a443c6a7309b2a4e28e0e0', 'request_id': 'req-d35a6197-8c73-4f4e-bf44-2c007732d633'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.665404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:02.669116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3ec784a4a443c6a7309b2a4e28e0e0', 'request_id': 'req-d35a6197-8c73-4f4e-bf44-2c007732d633'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.678356 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3ec784a4a443c6a7309b2a4e28e0e0', 'request_id': 'req-d35a6197-8c73-4f4e-bf44-2c007732d633'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.691531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] The token cache is being invalidate because project 5b3ec784a4a443c6a7309b2a4e28e0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:02.691900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.693272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d35a6197-8c73-4f4e-bf44-2c007732d633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.694929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1038/2071] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:02 2022] DELETE /identity/v3/projects/5b3ec784a4a443c6a7309b2a4e28e0e0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:02.700015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfa9e-fe23-4505-a39f-1cbfc9a36e3a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.700297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfa9e-fe23-4505-a39f-1cbfc9a36e3a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.700591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cfa9e-fe23-4505-a39f-1cbfc9a36e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.702791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:02.705650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5322903880e042e588a232a6869f173a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.720650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5322903880e042e588a232a6869f173a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.722259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a45cfa9e-fe23-4505-a39f-1cbfc9a36e3a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:02.724246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a45cfa9e-fe23-4505-a39f-1cbfc9a36e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.729972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5322903880e042e588a232a6869f173a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.730770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5322903880e042e588a232a6869f173a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.731372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bad70da2-0200-4ea6-8a0f-25a37932f07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5322903880e042e588a232a6869f173a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:02.747000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1034/2072] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:02 2022] DELETE /identity/v3/users/5322903880e042e588a232a6869f173a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:02.751365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.751645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.751916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.770670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:02.771957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.796509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1039/2073] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:02.805991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.806350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.806699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.827754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:02.829283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.838681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1035/2074] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:02.849312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:02.850949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:02.900747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1040/2075] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:02.905089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:02.909736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a479f3b-32ce-460f-8567-77b1124827b4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:02.914342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:02.914942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.915216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.915411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00d13-86d9-450f-8f13-6513be47dd2d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:02.915523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.920155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:02.920788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.921074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.921348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.922026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:02.922333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:02.923935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.925215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:02.927538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.938583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1036/2076] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:04:02.939105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1041/2077] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:02.943897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:02.953706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f04d5-7300-4176-84f9-bfee8540b4f3 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:02.958586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:02.959163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:02.959440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:02.959707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:02.960317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:02.962234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:02.992525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1037/2078] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:02 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:02.996839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.008445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72409-bb7d-491d-929b-d49797b5544e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.071434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.072087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.072313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.072615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.073326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.075207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.104069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:03.115598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1042/2079] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:02 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:03.117585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.135575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620169f-b72f-4321-b430-d4b2594b3ff7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.146790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.147644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.148119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.148631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.149725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.151690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.171950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1038/2080] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:03.177534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.202004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5a9ef-c1fc-43d2-99bb-02d46bbab9b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.217678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.219591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.221462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.222549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.224128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.226005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.239097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1043/2081] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:03.244258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.256155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.257618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6c82a-feb6-4901-8582-cd65b5ff9661 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.259556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:03.264124 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.265012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.265160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.265348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] PATH_INFO: `/v3/projects/ff91a1a61b394616bc94fd0b2d0cbfe9/users/cc2a8cf2dc6a407babc74ad954bbabe4/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.281042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41404abd-2a76-4123-8abe-9b96ec0cb3df admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.291736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.292371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.292690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.292943 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] PATH_INFO: `/v3/projects/8ab992b8bb69431bb266079ff5ebf1f3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.294186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab992b8bb69431bb266079ff5ebf1f3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.296448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.302958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff91a1a61b394616bc94fd0b2d0cbfe9, user_id=cc2a8cf2dc6a407babc74ad954bbabe4, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.305922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578312a5-9db2-4414-beaf-b00a6ad66b37 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.328533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1039/2082] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:03 2022] PUT /identity/v3/projects/ff91a1a61b394616bc94fd0b2d0cbfe9/users/cc2a8cf2dc6a407babc74ad954bbabe4/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:03.336187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.336569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.336799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.362953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab992b8bb69431bb266079ff5ebf1f3', 'request_id': 'req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.365709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:03.370437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab992b8bb69431bb266079ff5ebf1f3', 'request_id': 'req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.377447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] MFA Rules not processed for user `cc2a8cf2dc6a407babc74ad954bbabe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:03.380399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab992b8bb69431bb266079ff5ebf1f3', 'request_id': 'req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.380564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:03.393155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] The token cache is being invalidate because project 8ab992b8bb69431bb266079ff5ebf1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:03.393452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.394123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.396371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1044/2083] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:03 2022] DELETE /identity/v3/projects/8ab992b8bb69431bb266079ff5ebf1f3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:03.400766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.402449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:03.450590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1040/2084] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:03.464006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.465569 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:03.476796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b9de3-4492-4ad7-b21b-8c733a8d9a5e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.481773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.482590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.482954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.483442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] PATH_INFO: `/v3/users/e22848bd33e14a6c8d2c53af8757585c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.484684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22848bd33e14a6c8d2c53af8757585c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.486738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.532368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6b8ff-8af7-4946-b640-694eabae0299 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:03.536766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:03.537608 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:03.537899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:03.538257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:03.546363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22848bd33e14a6c8d2c53af8757585c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.550528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:03.552691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:03.556181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22848bd33e14a6c8d2c53af8757585c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.557251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22848bd33e14a6c8d2c53af8757585c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.559210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22848bd33e14a6c8d2c53af8757585c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.563047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1041/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:03.568258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6c73100e-604b-4c5c-84a8-06c1d7b338c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22848bd33e14a6c8d2c53af8757585c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:03.577439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:03.596144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1045/2086] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:03 2022] DELETE /identity/v3/users/e22848bd33e14a6c8d2c53af8757585c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:03.965374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:03.986826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d05e-e9ef-4782-80fa-e9c9fab2ebb7 service glance] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.073176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.074089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.074521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.074945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] PATH_INFO: `/v3/projects/b0ca999479a042f79cf61eac3709addb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.076226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ca999479a042f79cf61eac3709addb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.078362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.138371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:04.154946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ca999479a042f79cf61eac3709addb', 'request_id': 'req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.183151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ca999479a042f79cf61eac3709addb', 'request_id': 'req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.192519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ca999479a042f79cf61eac3709addb', 'request_id': 'req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.214815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] The token cache is being invalidate because project b0ca999479a042f79cf61eac3709addb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:04.215364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.216185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-618d2c7b-edf0-49b9-a15c-a7fadbd5e7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.218766 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1042/2087] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:03 2022] DELETE /identity/v3/projects/b0ca999479a042f79cf61eac3709addb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:04.225283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.225799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.226402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.251449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:04.252909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.346038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1046/2088] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:04.355765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.356053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.356333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.379658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:04.381329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.390542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1043/2089] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:04.395003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.409598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f71cb4-04d1-419a-90a3-fe0be86884f8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.415355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.416067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.416420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.416792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.417544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:04.417915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.419620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.437737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1047/2090] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:04.438715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.449246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e715235-4bef-4aaf-bb50-08d5db7a2086 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.454140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.455017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.455446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.455726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.456349 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.459068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.494767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1044/2091] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:04.500221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.501516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.502466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.522459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a646b6-8681-418e-9873-d35e77dccffd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.576578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589947e-8fc9-4dfb-a60e-15d8eb5d453b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.584442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.585100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.585383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.585654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.586288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.588588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.602147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.602811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.603130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.603504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] PATH_INFO: `/v3/users/9f4b21f022f34ff8bb72f8f88caa148d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.604909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4b21f022f34ff8bb72f8f88caa148d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.606973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.619098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1045/2092] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:04.620807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.631819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c7a92-de36-4785-b7a3-0a47ab84e8e2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.637025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.637772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.638377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.639012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.640380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.642352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.665691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1046/2093] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:04.671392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.672463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4b21f022f34ff8bb72f8f88caa148d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.683089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d211c2-df97-4ddf-80f4-808f73bc7f59 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.691691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4b21f022f34ff8bb72f8f88caa148d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.692668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4b21f022f34ff8bb72f8f88caa148d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.693780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4b21f022f34ff8bb72f8f88caa148d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.695106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.695695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.695977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.696249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.698051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.703690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6b582d22-a3af-47a9-96ee-8757cb03c8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4b21f022f34ff8bb72f8f88caa148d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:04.707997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.725794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1047/2094] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:04.729757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:04.730162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.732392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.736371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1048/2095] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:04 2022] DELETE /identity/v3/users/9f4b21f022f34ff8bb72f8f88caa148d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:04.743750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.744117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.744593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.746722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fbae9-b45c-4925-8dbe-ca860d0ba8e7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:04.769496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:04.772117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.816601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:04.817400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.817748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.818097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] PATH_INFO: `/v3/projects/841e083beb6146f88c919205b393b05b/users/97e47eadfeb84b3e891f9b8d15ade252/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.838101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841e083beb6146f88c919205b393b05b, user_id=97e47eadfeb84b3e891f9b8d15ade252, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:04.841346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2470399-051e-4272-892b-5143abb38a09 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:04.843379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1049/2096] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:04.844920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:04.856408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:04.859157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.860872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1048/2097] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:04 2022] PUT /identity/v3/projects/841e083beb6146f88c919205b393b05b/users/97e47eadfeb84b3e891f9b8d15ade252/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:04.871265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24492-4440-4872-862c-0790f294f292 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:04.871547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24492-4440-4872-862c-0790f294f292 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:04.871826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24492-4440-4872-862c-0790f294f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:04.917179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-73d24492-4440-4872-862c-0790f294f292 None None] MFA Rules not processed for user `97e47eadfeb84b3e891f9b8d15ade252`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:04.918490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-73d24492-4440-4872-862c-0790f294f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:04.941050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee286-ea4e-4851-97bf-a4dc785be034 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.015284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.015915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.016405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.016543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.017829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1049/2098] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:05.019445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d24492-4440-4872-862c-0790f294f292 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.099774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.100671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d24492-4440-4872-862c-0790f294f292 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.101414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.105597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.106266 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.107205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.107205 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.107378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.109367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.113426 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1050/2099] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:05.144875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1050/2100] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:05.149733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.158087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:05.162568 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759ca0-81bd-49ff-bee4-57e512df0b58 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.240872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.241409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.242936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.242936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.242936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.244793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.281508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1051/2101] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:05.287526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.310359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a1fb4-c521-4825-b3b4-2ee222fc3cca admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.319030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.320013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.320547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.321208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.321998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.323742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.341484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1051/2102] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:05.345621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.372770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6ec0f-4026-4f1d-bfe4-0c84a17cb68b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.390584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.391688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.391688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.391872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.393029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.395667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab4e6d-ff90-4ab8-8e43-e96aa1a6e5f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.411459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1052/2103] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:05.412718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.427893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c53aa-4f12-46e4-b37e-52f49b38b89e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.440938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.442084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.442593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.443267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] PATH_INFO: `/v3/projects/ff9e5debb2a24d65b19892578a3bc7be/users/62a72e33dcc2409dafc35c8735ae4f96/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.462587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9e5debb2a24d65b19892578a3bc7be, user_id=62a72e33dcc2409dafc35c8735ae4f96, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.465417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.490522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1052/2104] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:05 2022] PUT /identity/v3/projects/ff9e5debb2a24d65b19892578a3bc7be/users/62a72e33dcc2409dafc35c8735ae4f96/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:05.502203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.502844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.502844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.539575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.543068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] MFA Rules not processed for user `62a72e33dcc2409dafc35c8735ae4f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:05.543240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:05.544723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:05.606724 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:05.649182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f84ff-a804-434d-94a8-3b287a4be5e0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.651094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1053/2105] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:05.661302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.663953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.664598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.664880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.665154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] PATH_INFO: `/v3/projects/853edf763b51481fa63502e10ec4d241` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.666792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853edf763b51481fa63502e10ec4d241)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.668866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.675691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11b5d5-8c8a-4ab8-8291-66d9f94c56da None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.681962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.682573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.683300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.683300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.683942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.692746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.731897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853edf763b51481fa63502e10ec4d241', 'request_id': 'req-ffe84e76-d508-4dba-be95-eff9ac6d9c12'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:05.732125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1054/2106] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:05.736163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.740928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853edf763b51481fa63502e10ec4d241', 'request_id': 'req-ffe84e76-d508-4dba-be95-eff9ac6d9c12'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:05.747396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853edf763b51481fa63502e10ec4d241', 'request_id': 'req-ffe84e76-d508-4dba-be95-eff9ac6d9c12'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:05.763742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] The token cache is being invalidate because project 853edf763b51481fa63502e10ec4d241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:05.764102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:05.765872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ffe84e76-d508-4dba-be95-eff9ac6d9c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:05.766651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1053/2107] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:05 2022] DELETE /identity/v3/projects/853edf763b51481fa63502e10ec4d241 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:05.771946 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a12b0-c10c-4fe4-b5e2-3a3079d81253 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.774123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a12b0-c10c-4fe4-b5e2-3a3079d81253 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.774506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a12b0-c10c-4fe4-b5e2-3a3079d81253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.795486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:05.796403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-524a12b0-c10c-4fe4-b5e2-3a3079d81253 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:05.797807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-524a12b0-c10c-4fe4-b5e2-3a3079d81253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:05.811018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afeccf-3302-4469-ac3f-68c30390e679 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.817736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1054/2108] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:05.826287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.826635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.826974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.833676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.835464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.835895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.836310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.837215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.839312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.867033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1055/2109] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:05.872357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.873990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:05.874435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:05.875377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:05.886491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1055/2110] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:05.888782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e00770-1dbc-415e-8264-8d825e7b13d0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.891140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.900457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.901436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.901912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.902378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.903231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.905030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.906605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a778c-881e-4b04-8b5c-f9a1d475120f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.912325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.913007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.913298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.913571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.915747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:05.916065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.917250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1056/2111] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:05.920932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.921631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.935238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eea6b-60e1-434d-b2dd-db75143f3bac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.939778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1056/2112] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:05.941346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.942899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.943303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.943575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] PATH_INFO: `/v3/projects/ec45db938c0f441abb02b10b5148436d/users/a98a346b4b0245769fc0ffc70812fa8b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.944025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:05.961285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec45db938c0f441abb02b10b5148436d, user_id=a98a346b4b0245769fc0ffc70812fa8b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.965065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.971131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8a95-902b-4798-8cfd-ddbc54895c77 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:05.978854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:05.979473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:05.979755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:05.980027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:05.981022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:05.983402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1057/2113] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:05 2022] PUT /identity/v3/projects/ec45db938c0f441abb02b10b5148436d/users/a98a346b4b0245769fc0ffc70812fa8b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:05.986420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:05.990043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.040770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1057/2114] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:05 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:06.046400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.078717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06062af-f54f-48ed-b178-e0b960be6279 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.143514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964d8cd-ad89-484a-a543-0dcba7a1dd5c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.151335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.152629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.152920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.153201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.154000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.156070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.157808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.158433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.158715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.158988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.159745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.163014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.177881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1058/2115] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:06.181743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.194192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8faf-8fa4-4fe1-a398-ec0bea6801a3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.199540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.200051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.200334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.200784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] PATH_INFO: `/v3/projects/ec45db938c0f441abb02b10b5148436d/users/a98a346b4b0245769fc0ffc70812fa8b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.204681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1058/2116] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:06 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:06.204970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.207008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec45db938c0f441abb02b10b5148436d, user_id=a98a346b4b0245769fc0ffc70812fa8b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.210284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43417967-0ef3-4cdf-8e92-a321b0d629fd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.212293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:06.218706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e86a-3b22-4d02-be53-1e93d50199dd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.223736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1059/2117] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:06 2022] PUT /identity/v3/projects/ec45db938c0f441abb02b10b5148436d/users/a98a346b4b0245769fc0ffc70812fa8b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:06.234210 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.234486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.234905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.279616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] MFA Rules not processed for user `a98a346b4b0245769fc0ffc70812fa8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:06.281126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:06.325916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:06.339874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.340528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.340796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.341065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.341777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.343388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.368694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1059/2118] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:06.375035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.397792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5557ea-70dc-444c-a77b-56cde33538e8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.403897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1060/2119] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:06.404646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.405482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.406088 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.406199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.406970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.409192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.422229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1060/2120] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:04:06.426040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.434523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.440573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8345-4a51-4638-bad3-f60f2ca54ede None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.440948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:06.458872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.459640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.459993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.460448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] PATH_INFO: `/v3/projects/be795f4843d04a80ab3def7038187270/users/6264e299bab14c06ad8a62167225da8d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.485694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be795f4843d04a80ab3def7038187270, user_id=6264e299bab14c06ad8a62167225da8d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.490650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047495c-883e-4847-acff-f57c5bd86b25 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.521835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1061/2121] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:06 2022] PUT /identity/v3/projects/be795f4843d04a80ab3def7038187270/users/6264e299bab14c06ad8a62167225da8d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:06.540107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.540532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.542613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.580916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64ab6-efd6-47ba-966f-e14f43957909 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.583386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] MFA Rules not processed for user `6264e299bab14c06ad8a62167225da8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:06.586172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:06.667143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.667679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.668120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.668562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.672296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:06.707250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1062/2122] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:06.720280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.722513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:06.740339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba68e7-81b2-4f32-8811-3c1b78a6fbcc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.746335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.747458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.747752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.748027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.759809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.761320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.771641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1063/2123] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:04:06.774068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.776006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f5e79-619f-4c8f-b882-92129632ef11 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.786579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:06.793116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1061/2124] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:06.800672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:06.874130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0c5b2-7a30-4d01-bebd-2450d2d596b7 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:06.878809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:06.879473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:06.879758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:06.880067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] PATH_INFO: `/v3/users/6264e299bab14c06ad8a62167225da8d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:06.881195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6264e299bab14c06ad8a62167225da8d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:06.883115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:06.898656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:06.950074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6264e299bab14c06ad8a62167225da8d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:06.960791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6264e299bab14c06ad8a62167225da8d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:06.961430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6264e299bab14c06ad8a62167225da8d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:06.962146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6264e299bab14c06ad8a62167225da8d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:06.971257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6264e299bab14c06ad8a62167225da8d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:06.995629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1064/2125] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:06 2022] DELETE /identity/v3/users/6264e299bab14c06ad8a62167225da8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:07.000743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:07.001967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:07.002262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:07.027838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:07.029041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:07.140617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1062/2126] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:07.150415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:07.153580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:07.258883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b67e7-ed11-4d0d-9ac2-fc84d1df5262 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:07.263847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:07.264824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:07.265122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:07.265585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:07.276709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:07.278221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9d764-f065-4f93-948f-7e615358ac5b service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:07.289641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1065/2127] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:07.729786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:07.731889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:07.760701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a3f6e-dde8-43f6-abc8-51cf8ba9c86f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:07.765838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:07.766548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:07.766903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:07.767242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] PATH_INFO: `/v3/projects/be795f4843d04a80ab3def7038187270` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:07.768449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be795f4843d04a80ab3def7038187270)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:07.770959 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:07.836715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be795f4843d04a80ab3def7038187270', 'request_id': 'req-669b8eb0-c935-4e9f-af17-c05530b2c4c6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:07.842652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be795f4843d04a80ab3def7038187270', 'request_id': 'req-669b8eb0-c935-4e9f-af17-c05530b2c4c6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:07.852404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be795f4843d04a80ab3def7038187270', 'request_id': 'req-669b8eb0-c935-4e9f-af17-c05530b2c4c6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:07.867053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] The token cache is being invalidate because project be795f4843d04a80ab3def7038187270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:07.867342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:07.867991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-669b8eb0-c935-4e9f-af17-c05530b2c4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:07.870075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1063/2128] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:07 2022] DELETE /identity/v3/projects/be795f4843d04a80ab3def7038187270 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:07.874865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:07.875371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:07.875728 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:07.909815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:07.911170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:07.986342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1066/2129] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:07.994275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:07.994713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:07.995179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.017657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:08.018990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.027962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1064/2130] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:08.032361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.042619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a305-0e71-497d-b087-7824d0088fe9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.047326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.047935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.048218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.048503 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.049171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:08.049474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.051143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.062893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1067/2131] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:08.068116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.077318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6883f61-46d6-453d-b5a9-5c2a9cbc5441 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.083431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.083980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.084255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.084739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.085379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.087296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.114832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1065/2132] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:08 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:08.119121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.129926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5ae9-17fc-4768-8e1e-5663c222b50e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.151388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:08.205977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.206509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.206794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.207067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.208359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.210496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282feba-f786-4cbd-82f1-6f1a66d64b99 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.234368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1068/2133] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:08 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:08.238055 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.240973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfd28-8cf9-4b4f-ad91-3e7dbedab5c8 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.241327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfd28-8cf9-4b4f-ad91-3e7dbedab5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.241768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccfd28-8cf9-4b4f-ad91-3e7dbedab5c8 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.243232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1069/2134] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:04:08.253323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9c02-dfd4-4f99-ba0c-ccc69fd64c80 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.259958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.260738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.261066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.261415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.262160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.263798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.279882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1066/2135] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:08.283903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccfd28-8cf9-4b4f-ad91-3e7dbedab5c8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.302549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccfd28-8cf9-4b4f-ad91-3e7dbedab5c8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.309567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.310502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.310789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.311063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.311739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.313965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c66753-6a45-47f2-b8d7-dde5570c5cf5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.330141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1070/2136] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:08.335633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.352322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba08d2-026f-42ce-b750-0fc357a1f465 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.357259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.358075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.358360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.358630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] PATH_INFO: `/v3/projects/50a0d3a8f796403bb117893265c19061/users/fa935d6a0e814506a9ac2f168a058aae/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.376587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a0d3a8f796403bb117893265c19061, user_id=fa935d6a0e814506a9ac2f168a058aae, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.381082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.401874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1067/2137] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:08 2022] PUT /identity/v3/projects/50a0d3a8f796403bb117893265c19061/users/fa935d6a0e814506a9ac2f168a058aae/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:08.406936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e456fb-7c1a-47c9-9647-14f24f595865 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.407230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e456fb-7c1a-47c9-9647-14f24f595865 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.407490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e456fb-7c1a-47c9-9647-14f24f595865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.432094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86e456fb-7c1a-47c9-9647-14f24f595865 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:08.433332 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86e456fb-7c1a-47c9-9647-14f24f595865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.473800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.478193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.507682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:08.520543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1071/2138] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:08.520543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.521344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.521786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.549510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:08.550867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.559628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e55a0-ac80-4811-bcac-276b7db2d58b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.565215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.565914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.566259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.566606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.569966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.650632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1072/2139] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:08.652584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.653611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.654091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.655318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.672085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7ac57-e355-42ab-8b29-5df2dfa0be1b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.673592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1068/2140] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:04:08.674537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.676224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.683657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.685814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.686351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.686940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] PATH_INFO: `/v3/users/293351869c8f45688bb70ffc1e812485` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.688865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=293351869c8f45688bb70ffc1e812485)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.690981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.761267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:08.786574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293351869c8f45688bb70ffc1e812485'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:08.800780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293351869c8f45688bb70ffc1e812485'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:08.801893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293351869c8f45688bb70ffc1e812485'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:08.803904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293351869c8f45688bb70ffc1e812485'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:08.816526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293351869c8f45688bb70ffc1e812485'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:08.819773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d131a25-a79e-458b-810d-5686e6050d43 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.829728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.830472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.830753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.831023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.836512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.857598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1073/2141] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:08 2022] DELETE /identity/v3/users/293351869c8f45688bb70ffc1e812485 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:08.859367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:08.873238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:08.891944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:08.894155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:08.917633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1069/2142] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:08.983705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f988b0-4e80-4401-986f-bbff0ce9ae6b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:08.992092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:08.993912 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:08.994241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:08.994716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:08.997282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.030690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.033818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b6ed-03bd-440e-8454-5d52b7f49263 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.048352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1074/2143] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:09.133361 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.135772 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.154659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821fbbb-578e-4631-8a74-18991f2068f5 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.252118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.252789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.253086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.253341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] PATH_INFO: `/v3/projects/9bab0dbd4e67412783038c71b8aa0c71` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.255091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bab0dbd4e67412783038c71b8aa0c71)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.257274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.284590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:09.327034 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bab0dbd4e67412783038c71b8aa0c71', 'request_id': 'req-96642241-5509-4126-907c-624c9dc776f0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:09.337529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bab0dbd4e67412783038c71b8aa0c71', 'request_id': 'req-96642241-5509-4126-907c-624c9dc776f0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:09.347582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bab0dbd4e67412783038c71b8aa0c71', 'request_id': 'req-96642241-5509-4126-907c-624c9dc776f0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:09.367818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] The token cache is being invalidate because project 9bab0dbd4e67412783038c71b8aa0c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:09.368213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:09.369095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-96642241-5509-4126-907c-624c9dc776f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:09.371193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1070/2144] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:09 2022] DELETE /identity/v3/projects/9bab0dbd4e67412783038c71b8aa0c71 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:09.376760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.377247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.377716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.411870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:09.414006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.501117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1075/2145] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:09.511146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.511495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.512018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.533001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:09.533812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.534206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.535423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.544466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1071/2146] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:09.548638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.561062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf66004-140e-43eb-9641-ecb316da4dc2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.567365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.568164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.568448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.568793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.569478 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:09.569786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.571449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.586679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1072/2147] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:04:09.590721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.592296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:09.607985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba88e-68d4-4289-b9e9-12268436e782 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.609010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee2ee1-bafb-4acd-810a-2d3483774b8c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.612804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.613484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.614038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.614424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.614558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.615279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.615780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.616061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.616464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.616731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.619281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.657435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1073/2148] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:09 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:09.661241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.736609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.738480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d07cc-39f6-43db-a60d-8cd03b0ee678 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.759203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1076/2149] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:09.760669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.761581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.761811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.774734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619715-d7e1-4ef2-9655-fcb7e5f9fbb8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.781036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.786807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.787118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.787397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.788092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.790084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.799540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] MFA Rules not processed for user `fa935d6a0e814506a9ac2f168a058aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:09.801599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:09.818356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1074/2150] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:09 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:09.823642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.837509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932fa6-012a-4656-ac1a-3bc0d9ab304b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.847150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.847150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.847150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.847150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.847630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.848925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.871354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1075/2151] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:04:09.872466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.885472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9c0d8-1ddd-4e26-8276-ef4587e02b00 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.906902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.907523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.907818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.909650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.911118 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:09.914834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:09.940528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1076/2152] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:09.942728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.954031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1b5e-7be8-4752-a338-37ec97c919fa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:09.960018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:09.960951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:09.961434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:09.962125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] PATH_INFO: `/v3/projects/5764c1ce6cb9484ca6acdbc49d08d43f/users/af2ee3473be14aa281d2d1212179d884/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:09.973570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1077/2153] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:09.982571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:09.997211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5764c1ce6cb9484ca6acdbc49d08d43f, user_id=af2ee3473be14aa281d2d1212179d884, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.001191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c9c1-a433-4309-8e23-82efc5267841 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.023082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1077/2154] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:09 2022] PUT /identity/v3/projects/5764c1ce6cb9484ca6acdbc49d08d43f/users/af2ee3473be14aa281d2d1212179d884/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:10.033210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.033498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.033773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.054807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:10.073747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0923c-6d22-40bf-9f67-89e62c7abcbb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.074456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] MFA Rules not processed for user `af2ee3473be14aa281d2d1212179d884`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:10.079141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:10.112564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:10.146917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.147539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.147818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.148092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.158691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1078/2155] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:10.163662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.219000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.221051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.233273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1078/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:10.252109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715f67c-fffb-43fa-a1cb-b7427b7d75cb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.259123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.259919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.260776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.261010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.262343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.263804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.301010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1079/2157] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:10 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:10.306118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.321737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298cbf-fa80-4206-93e0-576660f1335f service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.387717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.388329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.388647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.389095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.389747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.391705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.415380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1079/2158] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:10 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:10.419780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.431685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46406c38-a24b-42fb-a323-6fd27edc205c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.437451 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.438053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.438326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.438652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.439301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.440888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.452250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1080/2159] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:10.456648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.470345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6fa0e-3657-415f-8c3c-06ff183fb720 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.481679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.482367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.482679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.482926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] PATH_INFO: `/v3/projects/f43fef92d90243c28d41a8daf9d38ad4/users/30236bf7aa434001bf3261561e26009f/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.500973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43fef92d90243c28d41a8daf9d38ad4, user_id=30236bf7aa434001bf3261561e26009f, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.503571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.518237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1080/2160] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:10 2022] PUT /identity/v3/projects/f43fef92d90243c28d41a8daf9d38ad4/users/30236bf7aa434001bf3261561e26009f/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:10.532755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.539854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae077c5-b18f-4587-a95e-fef1cf3702d4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.619441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.620059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.620340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.620792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.621439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.623062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8ba29-7eb9-4793-ae36-f49af5fd26b9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.634954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1081/2161] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:10.639093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.650520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce5279-a884-42ec-b001-ba6cc8bf4cf2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.659550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.660221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.661203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.661512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] PATH_INFO: `/v3/projects/f43fef92d90243c28d41a8daf9d38ad4/users/30236bf7aa434001bf3261561e26009f/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.663404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43fef92d90243c28d41a8daf9d38ad4, user_id=30236bf7aa434001bf3261561e26009f, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.666280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.677622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1081/2162] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:10 2022] PUT /identity/v3/projects/f43fef92d90243c28d41a8daf9d38ad4/users/30236bf7aa434001bf3261561e26009f/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:10.687991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.688378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.688693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.709905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:10.722505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] MFA Rules not processed for user `30236bf7aa434001bf3261561e26009f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:10.724317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:10.793682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1082/2163] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:10.806349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:10.808032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:10.856469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:10.870447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b574ea-d89d-41c3-8a48-d1602aeb250a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:10.874136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:10.874744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:10.875026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:10.875299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:10.885043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:10.886468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b544c-89c6-417a-a9f8-fa2b57cdebf3 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:10.896564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1082/2164] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:10.962663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:11.031639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d844e-a6a0-450a-9e76-0d1e66d34b20 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:11.037268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:11.037891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.038172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.038449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] PATH_INFO: `/v3/users/af2ee3473be14aa281d2d1212179d884` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.039578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2ee3473be14aa281d2d1212179d884)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:11.041525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:11.090187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2ee3473be14aa281d2d1212179d884'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.104097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2ee3473be14aa281d2d1212179d884'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.116170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2ee3473be14aa281d2d1212179d884'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.116914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2ee3473be14aa281d2d1212179d884'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.117837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2ee3473be14aa281d2d1212179d884'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.131333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1083/2165] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:10 2022] DELETE /identity/v3/users/af2ee3473be14aa281d2d1212179d884 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:11.136090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.136630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.137098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.160192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:11.162240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:11.240521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1083/2166] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:11.250825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:11.254392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:11.291134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:11.357830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaa31-9bf6-4862-9b85-f3b66ce4b8e8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:11.361471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:11.362150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.362434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.362702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.372824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:11.374409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e39ff-f450-4daa-a7f6-8eb196be3036 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:11.384379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1084/2167] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:11.652673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:11.654321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:11.672339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.672659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.672936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.684253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7e65b-0ea8-4642-bc68-1f40352e5e82 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:11.690085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:11.690733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.691012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.691288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] PATH_INFO: `/v3/projects/5764c1ce6cb9484ca6acdbc49d08d43f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.692512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5764c1ce6cb9484ca6acdbc49d08d43f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:11.694296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] MFA Rules not processed for user `fa935d6a0e814506a9ac2f168a058aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:11.694519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:11.695480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:11.745615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5764c1ce6cb9484ca6acdbc49d08d43f', 'request_id': 'req-6f082426-4dc1-4c72-bf0a-51ae099c29ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.751421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5764c1ce6cb9484ca6acdbc49d08d43f', 'request_id': 'req-6f082426-4dc1-4c72-bf0a-51ae099c29ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.754483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1085/2168] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:11.761207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5764c1ce6cb9484ca6acdbc49d08d43f', 'request_id': 'req-6f082426-4dc1-4c72-bf0a-51ae099c29ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.773130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] The token cache is being invalidate because project 5764c1ce6cb9484ca6acdbc49d08d43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:11.773297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.774015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.775812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1084/2169] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:11 2022] DELETE /identity/v3/projects/5764c1ce6cb9484ca6acdbc49d08d43f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:11.779801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:11.792072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1660a0f-6ced-483d-8e71-63985304f110 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:11.867035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:11.867660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:11.867942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:11.868217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] PATH_INFO: `/v3/users/30236bf7aa434001bf3261561e26009f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:11.869379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30236bf7aa434001bf3261561e26009f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:11.871307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:11.920031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30236bf7aa434001bf3261561e26009f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.931526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:11.933125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30236bf7aa434001bf3261561e26009f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.941509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30236bf7aa434001bf3261561e26009f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.942852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30236bf7aa434001bf3261561e26009f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.943507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-979a08dc-a7bc-4204-ab95-734299f78a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30236bf7aa434001bf3261561e26009f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:11.956372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1086/2170] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:11 2022] DELETE /identity/v3/users/30236bf7aa434001bf3261561e26009f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:12.242260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.243762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:12.258006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f082426-4dc1-4c72-bf0a-51ae099c29ad admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.319881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.320545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.320825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.321141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] PATH_INFO: `/v3/projects/f43fef92d90243c28d41a8daf9d38ad4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.322287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43fef92d90243c28d41a8daf9d38ad4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.324189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.335299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:12.380111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43fef92d90243c28d41a8daf9d38ad4', 'request_id': 'req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:12.386631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43fef92d90243c28d41a8daf9d38ad4', 'request_id': 'req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:12.405763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43fef92d90243c28d41a8daf9d38ad4', 'request_id': 'req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:12.420412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] The token cache is being invalidate because project f43fef92d90243c28d41a8daf9d38ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:12.420878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:12.421551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b22d2e7a-c242-4fc7-8c54-c1a27c6c0f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:12.424631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1085/2171] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:12 2022] DELETE /identity/v3/projects/f43fef92d90243c28d41a8daf9d38ad4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:12.428065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.428623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.428623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.452311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:12.453767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:12.548840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1087/2172] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:12.556899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.557196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.557445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.581664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:12.582940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:12.595566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1086/2173] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:12.598955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.609094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65203e-d9eb-4bf2-8ece-5488a287852b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.614748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.615445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.615787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.616120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.616956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:12.617319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.620697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.632518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1088/2174] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:04:12.635860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.648538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3dcf6-1f63-43cf-ad43-2e96d7f195a6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.653433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.654047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.654336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.654622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.655241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.657181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.689444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1087/2175] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:12 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:12.690787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.702416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54858726-c92e-464e-a19d-3f44f7d671c9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.761986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.762588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.762870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.763142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.763757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.765710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.786429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1089/2176] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:12 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:12.790556 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.800945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd1b1f-4547-4476-b7db-efa3da7355d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.806117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.806707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.806991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.807259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.807896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.809540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.820138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1088/2177] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:12.824077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.835027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243e8c-c5f8-41a1-beaa-ed18d869cadb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.839842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.840429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.840741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.841014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.841666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.843240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627166e-13d6-4863-a9e2-bd4fb2e9505e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.854878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1090/2178] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:12.859229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:12.869688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e97a-2413-4630-a17a-502193a255fc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:12.874718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:12.875496 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.875694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.875960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] PATH_INFO: `/v3/projects/abc1b52ebea943079ecc4290ddb08af7/users/82d32e41e4a145afa208d002f74ca040/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.904273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc1b52ebea943079ecc4290ddb08af7, user_id=82d32e41e4a145afa208d002f74ca040, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:12.906976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:12.921559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1089/2179] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:12 2022] PUT /identity/v3/projects/abc1b52ebea943079ecc4290ddb08af7/users/82d32e41e4a145afa208d002f74ca040/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:12.932186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:12.932467 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:12.932759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:12.963473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] MFA Rules not processed for user `82d32e41e4a145afa208d002f74ca040`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:12.965032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:13.006734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:13.046509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1091/2180] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:13.051100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.112567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be25d39-0c15-4d15-a944-0812b246943c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.117656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.118250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.118574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.118873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.120276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.122992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.151769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1090/2181] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:13 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:13.156007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.166777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20cc43-78dd-429a-8164-7b41ef4d75a2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.225140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.225748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.226029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.226306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.226935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.228884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.250259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1092/2182] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:13 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:13.254636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.268148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80558-f947-4a2b-9680-5eda6f44c831 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.273652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.274281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.274560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.274827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.275463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.277094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.287821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1091/2183] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:13.292056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.303629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3f64-e372-4a1e-9c56-00d38629256e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.308367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.309071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.309350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.309625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] PATH_INFO: `/v3/projects/51ea5f56a45e4837bab26146bc78729a/users/cd5a12b684fd47339cf047aeed3d559b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.325041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ea5f56a45e4837bab26146bc78729a, user_id=cd5a12b684fd47339cf047aeed3d559b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.327679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.341212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1093/2184] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:13 2022] PUT /identity/v3/projects/51ea5f56a45e4837bab26146bc78729a/users/cd5a12b684fd47339cf047aeed3d559b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:13.345234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.355578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa312b-834b-4b96-8e98-1358aa0512bc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.360192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:13.415283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.415916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.416193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.416459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.417122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.418775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac3b1f-09b8-4d3b-9949-34b1e84940e5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.428785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1092/2185] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:13.432991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.443926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031009ec-c568-42ac-9750-882eb6741092 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.448684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.449337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.449616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.449890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] PATH_INFO: `/v3/projects/51ea5f56a45e4837bab26146bc78729a/users/cd5a12b684fd47339cf047aeed3d559b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.452015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ea5f56a45e4837bab26146bc78729a, user_id=cd5a12b684fd47339cf047aeed3d559b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.454780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.467186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1094/2186] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:13 2022] PUT /identity/v3/projects/51ea5f56a45e4837bab26146bc78729a/users/cd5a12b684fd47339cf047aeed3d559b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:13.478712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.479009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.479290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.509103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] MFA Rules not processed for user `cd5a12b684fd47339cf047aeed3d559b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:13.510306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:13.585444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1093/2187] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:13.595405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.597276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:13.670107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370faa-8eca-45c6-bc44-5dcf1e97bf56 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.673800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.674400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.674679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.674952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.688835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.690524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.703896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1095/2188] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:13.808931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.810121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:13.816926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:13.818942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:13.831142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a64a-39ab-43a1-ac96-29a912e1d6ed service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.835500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.836093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.836369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.836680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.872506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:13.881841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a089ebd-4d4b-4876-b270-f393c57f226e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:13.886694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:13.887328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.887635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.887908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] PATH_INFO: `/v3/users/97e47eadfeb84b3e891f9b8d15ade252` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:13.889047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e47eadfeb84b3e891f9b8d15ade252)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.890957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.903549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:13.905028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31b198-5a92-428a-9e17-1e58949e79aa service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:13.917578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1096/2189] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:04:13.929315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:13.947449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e47eadfeb84b3e891f9b8d15ade252'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:13.956966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e47eadfeb84b3e891f9b8d15ade252'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:13.957675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e47eadfeb84b3e891f9b8d15ade252'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:13.958355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e47eadfeb84b3e891f9b8d15ade252'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:13.968420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e47eadfeb84b3e891f9b8d15ade252'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:13.986902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1094/2190] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:13 2022] DELETE /identity/v3/users/97e47eadfeb84b3e891f9b8d15ade252 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:13.991423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:13.991762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:13.991989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:14.014787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:14.016020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:14.085976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1097/2191] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:14.096248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:14.098233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:14.166220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39f648-65b6-4800-bc92-4ea539976c95 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:14.173264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:14.173833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:14.174116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:14.174392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:14.186075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:14.187788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:14.200951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1095/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:14.499353 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:14.500969 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:14.514065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed1a68-b3f8-46ad-b148-3aa9b3bee2f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:14.518675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:14.519441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:14.519721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:14.519990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] PATH_INFO: `/v3/projects/841e083beb6146f88c919205b393b05b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:14.521652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841e083beb6146f88c919205b393b05b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:14.523534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:14.571194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841e083beb6146f88c919205b393b05b', 'request_id': 'req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.576658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841e083beb6146f88c919205b393b05b', 'request_id': 'req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.583046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841e083beb6146f88c919205b393b05b', 'request_id': 'req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.595677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] The token cache is being invalidate because project 841e083beb6146f88c919205b393b05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:14.595968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.596642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.598136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1098/2193] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:14 2022] DELETE /identity/v3/projects/841e083beb6146f88c919205b393b05b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:14.602685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:14.612284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647300-adb1-464c-86d8-0055a2c28656 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:14.669777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:14.670405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:14.670683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:14.670954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] PATH_INFO: `/v3/users/62a72e33dcc2409dafc35c8735ae4f96` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:14.672053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a72e33dcc2409dafc35c8735ae4f96)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:14.674004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:14.723609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a72e33dcc2409dafc35c8735ae4f96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.733056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a72e33dcc2409dafc35c8735ae4f96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.733669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a72e33dcc2409dafc35c8735ae4f96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.734263 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a72e33dcc2409dafc35c8735ae4f96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.735459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:14.748028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a72e33dcc2409dafc35c8735ae4f96'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:14.767311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1096/2194] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:14 2022] DELETE /identity/v3/users/62a72e33dcc2409dafc35c8735ae4f96 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:15.057897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:15.059305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:15.076042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b8ade-ba26-4a8b-bcf4-96e283d27e24 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:15.142069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:15.154325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:15.154987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:15.155435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:15.155878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] PATH_INFO: `/v3/projects/ff9e5debb2a24d65b19892578a3bc7be` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:15.160121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9e5debb2a24d65b19892578a3bc7be)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:15.163328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:15.233549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9e5debb2a24d65b19892578a3bc7be', 'request_id': 'req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.239211 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9e5debb2a24d65b19892578a3bc7be', 'request_id': 'req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.245734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9e5debb2a24d65b19892578a3bc7be', 'request_id': 'req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.258471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] The token cache is being invalidate because project ff9e5debb2a24d65b19892578a3bc7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:15.258768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.259387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.260901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1099/2195] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:15 2022] DELETE /identity/v3/projects/ff9e5debb2a24d65b19892578a3bc7be => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:15.264839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:15.266306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:15.283242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c352cf-283d-4c67-b3bb-3812d862f09b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:15.363859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:15.365911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:15.365911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:15.366068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] PATH_INFO: `/v3/users/a98a346b4b0245769fc0ffc70812fa8b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:15.367297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98a346b4b0245769fc0ffc70812fa8b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:15.369297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:15.428682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98a346b4b0245769fc0ffc70812fa8b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.439828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98a346b4b0245769fc0ffc70812fa8b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.440494 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98a346b4b0245769fc0ffc70812fa8b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.441103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98a346b4b0245769fc0ffc70812fa8b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.448906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3c49aec3-29da-4ae3-8101-5bfb5d230cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98a346b4b0245769fc0ffc70812fa8b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.471442 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1097/2196] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:15 2022] DELETE /identity/v3/users/a98a346b4b0245769fc0ffc70812fa8b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:15.754310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:15.758136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:15.773575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aceda8-5c0f-46f9-98dd-9a21cfa49a50 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:15.835252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:15.835884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:15.836162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:15.836436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] PATH_INFO: `/v3/projects/ec45db938c0f441abb02b10b5148436d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:15.837605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec45db938c0f441abb02b10b5148436d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:15.839509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:15.886828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec45db938c0f441abb02b10b5148436d', 'request_id': 'req-066c6e67-fc70-473e-aab9-079bf6266f71'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.892243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec45db938c0f441abb02b10b5148436d', 'request_id': 'req-066c6e67-fc70-473e-aab9-079bf6266f71'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.898804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec45db938c0f441abb02b10b5148436d', 'request_id': 'req-066c6e67-fc70-473e-aab9-079bf6266f71'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.910839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] The token cache is being invalidate because project ec45db938c0f441abb02b10b5148436d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:15.911122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.911812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-066c6e67-fc70-473e-aab9-079bf6266f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:15.913437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1100/2197] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:15 2022] DELETE /identity/v3/projects/ec45db938c0f441abb02b10b5148436d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:15.918403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:15.918899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:15.918992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:15.938712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:15.939903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.009031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:16.039545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1098/2198] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:16.047153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.047434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.047733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.070158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:16.071515 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.080850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1101/2199] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:16.088111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.097033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca88818-7a53-4c08-8f37-fd321e705cc6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.105761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.107248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.107624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.107965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.108666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:16.108974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.110578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.126916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1099/2200] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:04:16.127958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.138679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c79d6-0c8f-4401-932a-3c77b056ef36 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.143612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.144206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.144498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.144771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.145396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.148518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.153204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:16.187350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1102/2201] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:16 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:16.191487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.202853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf237b5-bc76-461a-9716-0035089ff0d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.271248 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.271772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.272054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.272328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.273069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.275125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.296558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1100/2202] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:16 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:16.300701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.312547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9fe4-1eba-42d8-af57-2d536bf7c7b2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.317273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.317974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.318367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.318367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.319365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.320977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.331326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1103/2203] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:16.335425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.345220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df443c-e703-4009-91b2-7627e8818d8c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.350422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.351135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.351373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.351682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.352345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.353976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d06206-f22d-4282-a3ba-d6025d97dfb1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.364339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1101/2204] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:16.369335 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.380563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697ff95-76cf-4060-86ca-ce27c06b476a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.385363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.386013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.386293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.386594 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] PATH_INFO: `/v3/projects/2f90e1856aed42e79b0e12648728ee8c/users/44d416128cf444efa830d21833eb2610/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.401101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f90e1856aed42e79b0e12648728ee8c, user_id=44d416128cf444efa830d21833eb2610, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.403732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.416599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1104/2205] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:16 2022] PUT /identity/v3/projects/2f90e1856aed42e79b0e12648728ee8c/users/44d416128cf444efa830d21833eb2610/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:16.427631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fa2d-9cda-4083-8b87-7b58a8f56eca None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.428582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fa2d-9cda-4083-8b87-7b58a8f56eca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.428856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1fa2d-9cda-4083-8b87-7b58a8f56eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.461983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-16a1fa2d-9cda-4083-8b87-7b58a8f56eca None None] MFA Rules not processed for user `44d416128cf444efa830d21833eb2610`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:16.463193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-16a1fa2d-9cda-4083-8b87-7b58a8f56eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.531523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1102/2206] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:16.598043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.599802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.667997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa32d8e-5cf0-4915-bb4a-7697af52f3bb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.673270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.674102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.674440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.674817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] PATH_INFO: `/v3/users/82d32e41e4a145afa208d002f74ca040` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.676074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d32e41e4a145afa208d002f74ca040)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.679001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.726372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d32e41e4a145afa208d002f74ca040'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:16.737820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d32e41e4a145afa208d002f74ca040'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:16.745974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d32e41e4a145afa208d002f74ca040'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:16.746702 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d32e41e4a145afa208d002f74ca040'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:16.747333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d32e41e4a145afa208d002f74ca040'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:16.762913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1105/2207] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:16 2022] DELETE /identity/v3/users/82d32e41e4a145afa208d002f74ca040 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:16.767452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.767892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.768297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.787592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:16.788748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.832631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:16.851314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1103/2208] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:16.861069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:16.862776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:16.895706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:16.924091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0bdb0-53bf-4ba7-a5d8-140d939f4edb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:16.928440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:16.929101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:16.929377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:16.929661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:16.939247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:16.940990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:16.953066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1106/2209] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:17.244007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:17.250034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:17.264276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800bfba-8623-4a80-9153-d36f36aa741f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:17.274876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:17.275612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:17.275975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:17.276317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] PATH_INFO: `/v3/projects/abc1b52ebea943079ecc4290ddb08af7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:17.277614 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc1b52ebea943079ecc4290ddb08af7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:17.279601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:17.339936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc1b52ebea943079ecc4290ddb08af7', 'request_id': 'req-deea2e26-dcfc-4f87-b2ff-e365a06e2148'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.346497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc1b52ebea943079ecc4290ddb08af7', 'request_id': 'req-deea2e26-dcfc-4f87-b2ff-e365a06e2148'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.355355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc1b52ebea943079ecc4290ddb08af7', 'request_id': 'req-deea2e26-dcfc-4f87-b2ff-e365a06e2148'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.369113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] The token cache is being invalidate because project abc1b52ebea943079ecc4290ddb08af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:17.369405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.370076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.371624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1104/2210] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:17 2022] DELETE /identity/v3/projects/abc1b52ebea943079ecc4290ddb08af7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:04:17.376407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:17.386994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffcd4d-5282-46f6-bdd8-46bce169e2aa service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:17.444036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:17.445010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:17.445386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:17.445680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] PATH_INFO: `/v3/users/cd5a12b684fd47339cf047aeed3d559b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:17.446800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd5a12b684fd47339cf047aeed3d559b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:17.449303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:17.501246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd5a12b684fd47339cf047aeed3d559b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.513773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd5a12b684fd47339cf047aeed3d559b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.520374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd5a12b684fd47339cf047aeed3d559b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.521068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd5a12b684fd47339cf047aeed3d559b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.522267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e5204518-836c-4279-98b8-8f3cfe34f668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd5a12b684fd47339cf047aeed3d559b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.534819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1107/2211] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:17 2022] DELETE /identity/v3/users/cd5a12b684fd47339cf047aeed3d559b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:17.817631 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:17.819554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:17.834041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2e26-dcfc-4f87-b2ff-e365a06e2148 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:17.899359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:17.899994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:17.900272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:17.900594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] PATH_INFO: `/v3/projects/51ea5f56a45e4837bab26146bc78729a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:17.901740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ea5f56a45e4837bab26146bc78729a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:17.903633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:17.951901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ea5f56a45e4837bab26146bc78729a', 'request_id': 'req-d18e409c-8696-4a58-985e-bccb1be0f121'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.957668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ea5f56a45e4837bab26146bc78729a', 'request_id': 'req-d18e409c-8696-4a58-985e-bccb1be0f121'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.965976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ea5f56a45e4837bab26146bc78729a', 'request_id': 'req-d18e409c-8696-4a58-985e-bccb1be0f121'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.975633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:17.980217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] The token cache is being invalidate because project 51ea5f56a45e4837bab26146bc78729a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:17.980596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.981704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d18e409c-8696-4a58-985e-bccb1be0f121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:17.983541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1105/2212] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:17 2022] DELETE /identity/v3/projects/51ea5f56a45e4837bab26146bc78729a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:17.988870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:17.989378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:17.989473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.010198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:18.011567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:18.057531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:18.074343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1108/2213] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:18.082380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.082668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.082946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.103103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:18.104435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:18.112499 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1106/2214] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:18.117206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.127177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa9eec-19cb-4f99-a14d-5f3a5a3b85b9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.132370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.133003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.133285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.133560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.134212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:18.134521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.136112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.147560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1109/2215] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:18.151834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.161116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6319f69-6e76-42e5-8bb5-22315da77e33 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.166570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.167159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.167436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.167705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.168334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.170301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.199144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1107/2216] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:18 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:18.203354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.214174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a831b-f154-4b75-8b03-7263eb897c0d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.277276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.277887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.278168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.278439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.279080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.281189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.304562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1110/2217] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:18 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:18.308616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.319823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1ca9e-2edf-4424-9333-7cfd6030d9ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.324353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.324971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.325249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.325518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.326172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.327760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.337752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1108/2218] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:18.341665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.353290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01322e4a-5aac-47da-b3ae-61a72eb94a97 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.358141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.358733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.359015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.359289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.359936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.361572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a019-4293-4dfa-bc7d-9b5f0a4a5e72 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.373068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1111/2219] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:04:18.382359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.392512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5e0e-6a1e-451f-8dde-6f1ffe2b95bc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.398077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.398732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.399012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.399283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] PATH_INFO: `/v3/projects/ccbd369a16c34f1284879f4e9390b5f4/users/9b1f1832a775468eb737e8be4a6be4cc/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.414350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbd369a16c34f1284879f4e9390b5f4, user_id=9b1f1832a775468eb737e8be4a6be4cc, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.416958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.435421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1109/2220] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:18 2022] PUT /identity/v3/projects/ccbd369a16c34f1284879f4e9390b5f4/users/9b1f1832a775468eb737e8be4a6be4cc/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:18.440675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672779-3580-4f13-abb1-26be7deb1580 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.440963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672779-3580-4f13-abb1-26be7deb1580 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.441287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d672779-3580-4f13-abb1-26be7deb1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.461930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5d672779-3580-4f13-abb1-26be7deb1580 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:18.463137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5d672779-3580-4f13-abb1-26be7deb1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:18.528547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1112/2221] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:18.538224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:18.539900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:18.599923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e309894-36f7-4750-a9b1-4baac07043e0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:18.603786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:18.604419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:18.604730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:18.605003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:18.613883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:18.616060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:18.625396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1110/2222] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:19.319609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e630ef-e81e-40a3-89ce-337376b1b713 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:19.320293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e630ef-e81e-40a3-89ce-337376b1b713 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:19.320293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e630ef-e81e-40a3-89ce-337376b1b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:19.359005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-66e630ef-e81e-40a3-89ce-337376b1b713 None None] MFA Rules not processed for user `9b1f1832a775468eb737e8be4a6be4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:19.360274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-66e630ef-e81e-40a3-89ce-337376b1b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:19.411134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:19.432891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1113/2223] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:19.443415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:19.445473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:19.506347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff9648-d9a3-4eaf-a6c0-e484fc586cfb service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:19.510160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:19.510771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:19.511039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:19.511307 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:19.520502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:19.522037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:19.531944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1111/2224] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:20.921692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:20.922196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:20.922299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:20.941263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] MFA Rules not processed for user `9b1f1832a775468eb737e8be4a6be4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:20.942505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:20.950061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1114/2225] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:25.021610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:25.023659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:25.074119 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:25.086283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3797-3a0d-46b1-8cc2-99590ce1c2d0 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:25.089877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:25.090467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:25.090743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:25.091013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:25.092777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:25.150094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:25.151517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06766b6-a1c2-4850-a135-ba6cb5a309f2 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:25.161145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1112/2226] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:30.936069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:34.464642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:34.466185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:34.481330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97741-b99c-4eed-aee1-d86118bfd0f8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:34.490044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:34.490801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:34.491133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:34.491596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] PATH_INFO: `/v3/users/cc2a8cf2dc6a407babc74ad954bbabe4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:34.493888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2a8cf2dc6a407babc74ad954bbabe4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:34.496220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:34.553147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2a8cf2dc6a407babc74ad954bbabe4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:34.572780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2a8cf2dc6a407babc74ad954bbabe4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:34.582382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2a8cf2dc6a407babc74ad954bbabe4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:34.583311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2a8cf2dc6a407babc74ad954bbabe4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:34.584084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2a8cf2dc6a407babc74ad954bbabe4'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:34.602443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1115/2227] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:34 2022] DELETE /identity/v3/users/cc2a8cf2dc6a407babc74ad954bbabe4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:34.606718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:34.607229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:34.607316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:34.636074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:34.637601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:34.724039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1113/2228] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:34.735557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:34.737085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:34.811104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ef3a-2568-4edc-80f6-2a7766a13bad admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:34.815735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:34.816992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:34.817123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:34.817574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:34.835036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:34.837346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9173ee-17cd-4247-b95d-73cd863f956f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:34.848043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1116/2229] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:35.248709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.250204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:35.268421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacb027-96b5-4560-ae87-c31cf7d001a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.273242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.273909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.274178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.274554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] PATH_INFO: `/v3/projects/ff91a1a61b394616bc94fd0b2d0cbfe9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.275724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff91a1a61b394616bc94fd0b2d0cbfe9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.277703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.332125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff91a1a61b394616bc94fd0b2d0cbfe9', 'request_id': 'req-904efa8e-504e-4fe7-b1ec-8d293a3a4846'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:35.341625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff91a1a61b394616bc94fd0b2d0cbfe9', 'request_id': 'req-904efa8e-504e-4fe7-b1ec-8d293a3a4846'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:35.349418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff91a1a61b394616bc94fd0b2d0cbfe9', 'request_id': 'req-904efa8e-504e-4fe7-b1ec-8d293a3a4846'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:35.360882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] The token cache is being invalidate because project ff91a1a61b394616bc94fd0b2d0cbfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:35.361175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:35.361806 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-904efa8e-504e-4fe7-b1ec-8d293a3a4846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:35.363278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1114/2230] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:35 2022] DELETE /identity/v3/projects/ff91a1a61b394616bc94fd0b2d0cbfe9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:35.368795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.369083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.369343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.391625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:35.392858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:35.453844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1117/2231] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:35.462491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.462777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.463050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.483138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:35.486304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:35.494667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1115/2232] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:35.498897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.509372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359ec5f-a076-431c-9864-4502f08e7bdd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.513993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.514597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.514878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.515150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.515805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:35.516113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.517740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.531541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1118/2233] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:35.535786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.545926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458045-985e-4661-9b58-cd26f8a06944 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.551232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.552368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.552671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.553106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.553893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.555904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.568025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:35.592117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1116/2234] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:35.592987 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.598251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:35.604874 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751189e-5222-481a-81c0-0f8eaed07ab0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.663120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.663725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.664049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.664437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.665084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.666974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.687443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1119/2235] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:04:35.691589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.702473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc80c9-f63c-472e-9309-cf94281b20ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.707519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.708144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.708423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.708724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.709368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.711012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.726038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1117/2236] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:04:35.726626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.736829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc7934-9892-4f70-8716-c14d6f9f5d7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.741553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.742168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.742575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.742875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.743505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.745130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04e5b1-7e75-4207-b0d4-5a2e9453ac5c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.755885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1120/2237] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:35.760473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:35.770784 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56430939-f01b-4213-98bb-de085bb5460e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:35.776188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:35.776914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.777194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.777480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] PATH_INFO: `/v3/projects/b2fa771591cb4278af427ffd61b470cf/users/cb87900dcb2b4459972a39fddaf0262e/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.795868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fa771591cb4278af427ffd61b470cf, user_id=cb87900dcb2b4459972a39fddaf0262e, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:35.798660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:35.814089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1118/2238] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:35 2022] PUT /identity/v3/projects/b2fa771591cb4278af427ffd61b470cf/users/cb87900dcb2b4459972a39fddaf0262e/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:35.825780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:35.826098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:35.826379 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:35.866148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] MFA Rules not processed for user `cb87900dcb2b4459972a39fddaf0262e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:35.868905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:35.972030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1121/2239] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:35.976207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.083606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f75a4-5d02-471a-bbe8-926537dc61c3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.094191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.094903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.095266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.095540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.096173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.098121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.132359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1119/2240] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:36.137081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.148186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89bd54-3921-412a-ae8b-a3a75e1090e9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.239584 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.240203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.240544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.240822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.241461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.244181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.261800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:36.272293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1122/2241] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:36 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:36.274085 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.287110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb7a6-deea-440e-a999-f16cc94ef7ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.293461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.294074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.294355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.294641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.295393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.297431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.314596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.322003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1120/2242] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:36.326808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8fa50-eeb1-42ad-9877-eaf066682ab7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.332279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.332998 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.333350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.333720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.334376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.336043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea980ca8-9b3f-49af-aad3-31b320005158 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.349084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1123/2243] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:04:36.353845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.364744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7b54-5d92-44df-9179-081a57395734 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.370233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.371150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.371446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.371725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] PATH_INFO: `/v3/projects/13e1c3732b0749cab02f112bd71ed5f9/users/c9959cc1ad8c4532834b32984bc3622a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.390067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e1c3732b0749cab02f112bd71ed5f9, user_id=c9959cc1ad8c4532834b32984bc3622a, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.393023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.408251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1121/2244] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:36 2022] PUT /identity/v3/projects/13e1c3732b0749cab02f112bd71ed5f9/users/c9959cc1ad8c4532834b32984bc3622a/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:36.420030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.420321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.420651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.450850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] MFA Rules not processed for user `c9959cc1ad8c4532834b32984bc3622a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:36.451740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:36.519630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1124/2245] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:36.524886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.588517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e7827-66c5-4c0d-9167-1aa68c93e166 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.593212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.593820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.594103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.594377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.595000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.596954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.607916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:36.626890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1122/2246] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:36 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:36.630903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.642737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60266d-2ea8-4321-a27c-4f483f145393 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.708988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.709536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.709812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.710795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.710795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.712907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.735042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1125/2247] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:36 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:36.739178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.752274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a935fd-590a-4a72-b9b5-be1c15612167 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.756839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.757457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.757815 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.758625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.759276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.760920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.771207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1123/2248] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:36.775374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.785866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd864-c5b1-48f5-95fb-b73be3b11c43 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.790843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.791491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.791768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.792037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] PATH_INFO: `/v3/projects/195b349cceef45edbd086d4f9141534b/users/5d30cfe340b84d2e9dcceed3b8564f3c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.807169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=195b349cceef45edbd086d4f9141534b, user_id=5d30cfe340b84d2e9dcceed3b8564f3c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.809811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.822777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1126/2249] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:36 2022] PUT /identity/v3/projects/195b349cceef45edbd086d4f9141534b/users/5d30cfe340b84d2e9dcceed3b8564f3c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:36.826838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.836968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba58c3c-6e0a-4ca9-b950-341973c99f3a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.895541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.896150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.896432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.896736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.897374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.899016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15a81f-154e-4db8-9ca8-8e3d968a8000 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.908644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1124/2250] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:36.912894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:36.931538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f77cca-b3f5-4870-9115-2a8e3d1d89bb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:36.936529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:36.937217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.937492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.937763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] PATH_INFO: `/v3/projects/195b349cceef45edbd086d4f9141534b/users/5d30cfe340b84d2e9dcceed3b8564f3c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:36.939739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195b349cceef45edbd086d4f9141534b, user_id=5d30cfe340b84d2e9dcceed3b8564f3c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:36.942411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:36.953440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1127/2251] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:36 2022] PUT /identity/v3/projects/195b349cceef45edbd086d4f9141534b/users/5d30cfe340b84d2e9dcceed3b8564f3c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:36.964988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:36.965206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:36.965477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:37.000786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] MFA Rules not processed for user `5d30cfe340b84d2e9dcceed3b8564f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:37.001996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:37.096427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1125/2252] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:37.105755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:37.109908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:37.147915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:37.175202 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009ccbb-6ceb-4553-a9c1-0707eb749ba1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:37.179135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:37.179982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:37.180329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:37.180707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:37.247051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:37.248520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:37.259240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1128/2253] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:38.841470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:38.851196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d05f3-dfc3-4406-8423-3955480e76da None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:38.854900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:38.855498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:38.855781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:38.856056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:38.918107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:38.919497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:38.927507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:38.932382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1126/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:39.582378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:39.591685 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac391-2afb-45fc-acfb-da200b05543f service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:39.601984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:39.602607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:39.603025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:39.603300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:39.627026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:39.628613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79853ec7-9f68-4d92-b598-024349ef98a9 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:39.639759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1129/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:40.855291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:40.856840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:40.957062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42963-7616-4ba5-a6ba-6eccdec77871 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:40.962545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:40.963161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:40.963437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:40.963708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] PATH_INFO: `/v3/users/f6b4977ff00841399906870d9314ea02` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:40.964853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b4977ff00841399906870d9314ea02)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:40.966781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:41.018672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b4977ff00841399906870d9314ea02'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.028474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b4977ff00841399906870d9314ea02'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.029107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b4977ff00841399906870d9314ea02'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.029715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b4977ff00841399906870d9314ea02'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.036865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b4977ff00841399906870d9314ea02'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.062917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1127/2256] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:40 2022] DELETE /identity/v3/users/f6b4977ff00841399906870d9314ea02 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:41.067501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:41.068362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:41.068736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:41.089902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:41.091046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:41.163847 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1130/2257] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:41.174528 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:41.175924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:41.239841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37a4a-bcd7-4a65-bd40-28ab9432afef admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:41.243648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:41.244284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:41.244574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:41.244853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:41.254032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:41.255410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:41.264823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1128/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:41.552520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:41.552520 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:41.563326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92b6b-a2fb-477f-8c3f-196d2b43bd1b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:41.568091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:41.568760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:41.569042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:41.569313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] PATH_INFO: `/v3/projects/51182debcc284221aade6594719febc6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:41.570957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51182debcc284221aade6594719febc6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:41.572900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:41.620773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51182debcc284221aade6594719febc6', 'request_id': 'req-36929bbf-6743-4693-9281-92d5dbd21146'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.626308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51182debcc284221aade6594719febc6', 'request_id': 'req-36929bbf-6743-4693-9281-92d5dbd21146'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.632369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51182debcc284221aade6594719febc6', 'request_id': 'req-36929bbf-6743-4693-9281-92d5dbd21146'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.636687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:41.647803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] The token cache is being invalidate because project 51182debcc284221aade6594719febc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:41.648341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.649778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-36929bbf-6743-4693-9281-92d5dbd21146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:41.657188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1131/2259] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:41 2022] DELETE /identity/v3/projects/51182debcc284221aade6594719febc6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:43.744805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:43.747952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:43.766410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6883acf-01ea-4831-9535-a735ffcc16c9 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:43.798377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:43.858193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:43.858840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:43.859120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:43.859459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] PATH_INFO: `/v3/users/cb87900dcb2b4459972a39fddaf0262e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:43.869435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb87900dcb2b4459972a39fddaf0262e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:43.871464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:43.931525 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb87900dcb2b4459972a39fddaf0262e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:43.939218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb87900dcb2b4459972a39fddaf0262e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:43.940001 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb87900dcb2b4459972a39fddaf0262e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:43.940654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb87900dcb2b4459972a39fddaf0262e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:43.947894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb87900dcb2b4459972a39fddaf0262e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:43.968589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1129/2260] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:43 2022] DELETE /identity/v3/users/cb87900dcb2b4459972a39fddaf0262e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:43.971564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:43.972041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:43.972292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:43.994837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:43.996123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:44.061936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1132/2261] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:44.071774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:44.073221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:44.130393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492020b-8793-448a-8b66-8ac0fc8e0c77 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:44.134504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:44.135212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:44.135517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:44.135790 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:44.145651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:44.147019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:44.156960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1130/2262] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:44.566299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:44.567867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:44.580796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0c74f-cfe4-4e02-9aa8-ac51e75fddce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:44.585409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:44.586681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:44.587113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:44.587548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] PATH_INFO: `/v3/projects/b2fa771591cb4278af427ffd61b470cf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:44.589504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fa771591cb4278af427ffd61b470cf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:44.590893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:44.642862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fa771591cb4278af427ffd61b470cf', 'request_id': 'req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.648180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fa771591cb4278af427ffd61b470cf', 'request_id': 'req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.659833 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fa771591cb4278af427ffd61b470cf', 'request_id': 'req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.672721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] The token cache is being invalidate because project b2fa771591cb4278af427ffd61b470cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:44.672941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.673643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.675199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1133/2263] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:44 2022] DELETE /identity/v3/projects/b2fa771591cb4278af427ffd61b470cf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:44.679155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:44.689222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576843a-7af2-4b16-88e9-0fafb3bba371 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:44.731982 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:44.749817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:44.750439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:44.750717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:44.751018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] PATH_INFO: `/v3/users/c9959cc1ad8c4532834b32984bc3622a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:44.752158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9959cc1ad8c4532834b32984bc3622a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:44.754115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:44.799608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9959cc1ad8c4532834b32984bc3622a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.807222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9959cc1ad8c4532834b32984bc3622a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.807857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9959cc1ad8c4532834b32984bc3622a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.808445 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9959cc1ad8c4532834b32984bc3622a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.816571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9959cc1ad8c4532834b32984bc3622a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:44.834399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1131/2264] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:44 2022] DELETE /identity/v3/users/c9959cc1ad8c4532834b32984bc3622a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:45.152368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:45.153838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:45.168556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f3bbc-d5e3-4400-96dd-d6a54eee0666 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:45.230652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:45.231352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:45.231638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:45.231913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] PATH_INFO: `/v3/projects/13e1c3732b0749cab02f112bd71ed5f9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:45.233316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e1c3732b0749cab02f112bd71ed5f9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:45.236607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:45.263169 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:45.287385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e1c3732b0749cab02f112bd71ed5f9', 'request_id': 'req-35c70ef4-5bf0-4b1a-9241-bd357f88f096'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.292961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e1c3732b0749cab02f112bd71ed5f9', 'request_id': 'req-35c70ef4-5bf0-4b1a-9241-bd357f88f096'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.299089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e1c3732b0749cab02f112bd71ed5f9', 'request_id': 'req-35c70ef4-5bf0-4b1a-9241-bd357f88f096'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.312302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] The token cache is being invalidate because project 13e1c3732b0749cab02f112bd71ed5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:45.312618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.313841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.315413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1134/2265] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:45 2022] DELETE /identity/v3/projects/13e1c3732b0749cab02f112bd71ed5f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:45.319374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:45.321536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:45.334552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e1250-4da1-473f-a829-bf9446c33d8b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:45.391244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:45.391868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:45.392145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:45.392417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] PATH_INFO: `/v3/users/5d30cfe340b84d2e9dcceed3b8564f3c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:45.393576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d30cfe340b84d2e9dcceed3b8564f3c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:45.395488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:45.441321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d30cfe340b84d2e9dcceed3b8564f3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.449183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d30cfe340b84d2e9dcceed3b8564f3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.449766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d30cfe340b84d2e9dcceed3b8564f3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.450363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d30cfe340b84d2e9dcceed3b8564f3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.457377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3d06de68-4f71-4472-bfc6-48e7d2383ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d30cfe340b84d2e9dcceed3b8564f3c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.459219 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:45.476756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1132/2266] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:45 2022] DELETE /identity/v3/users/5d30cfe340b84d2e9dcceed3b8564f3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:45.756688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:45.758854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:45.772612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70ef4-5bf0-4b1a-9241-bd357f88f096 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:45.829961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:45.830582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:45.830860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:45.831129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] PATH_INFO: `/v3/projects/195b349cceef45edbd086d4f9141534b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:45.832226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=195b349cceef45edbd086d4f9141534b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:45.834141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:45.880652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195b349cceef45edbd086d4f9141534b', 'request_id': 'req-fe91f2ad-454d-4e91-8b2d-a3588882d88f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.886652 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195b349cceef45edbd086d4f9141534b', 'request_id': 'req-fe91f2ad-454d-4e91-8b2d-a3588882d88f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.892804 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195b349cceef45edbd086d4f9141534b', 'request_id': 'req-fe91f2ad-454d-4e91-8b2d-a3588882d88f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.905340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] The token cache is being invalidate because project 195b349cceef45edbd086d4f9141534b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:04:45.905627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.906253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fe91f2ad-454d-4e91-8b2d-a3588882d88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:45.907770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1135/2267] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:45 2022] DELETE /identity/v3/projects/195b349cceef45edbd086d4f9141534b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:45.913833 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:45.914320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:45.914487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:45.936703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:45.937766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:46.005279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1133/2268] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:46.014210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.014490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.014761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.037342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:46.038556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:46.047027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1136/2269] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:46.051394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.061787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac399-451c-41e6-8c74-537bcb51b795 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.066382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.067011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.067293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.067566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.068208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:04:46.068545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.070134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.082296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1134/2270] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:04:46.086785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.096316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230c5d3-7b2b-4cec-8766-8015226fb264 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.100986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.102145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.102563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.103243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.104309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.106926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.142196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1137/2271] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:04:46 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:46.146436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.157293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c963b-9ff8-42d9-99a2-697aab225eb7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.220926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.221551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.221849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.222148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.222747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.225925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.252471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1135/2272] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:04:46 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:04:46.256651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.267845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53596159-7584-47b2-9b07-a63151f72642 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.272427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.273051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.273960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.274398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.275142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.276759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.282130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:46.287892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1138/2273] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:46.291770 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.302283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ec03-757b-455a-9eca-830096952370 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.307193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.307922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.308231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.308547 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.309357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.311040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43035d-db93-47a3-a311-6628475cf7dc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.322864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1136/2274] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:04:46.327035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.338727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcafb73-4505-4823-b420-47e96b18fdc9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.344175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.344868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.345176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.345456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] PATH_INFO: `/v3/projects/810f4ad2015d4491ba4ea05ff17d4f68/users/c41f54152b384425b6c5eae24dc32f04/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.361377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=810f4ad2015d4491ba4ea05ff17d4f68, user_id=c41f54152b384425b6c5eae24dc32f04, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.364109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.381106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1139/2275] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:04:46 2022] PUT /identity/v3/projects/810f4ad2015d4491ba4ea05ff17d4f68/users/c41f54152b384425b6c5eae24dc32f04/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:46.391799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029e9f-dc22-48b5-83df-ef29b083952d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.392104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029e9f-dc22-48b5-83df-ef29b083952d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.392378 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029e9f-dc22-48b5-83df-ef29b083952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.428644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-63029e9f-dc22-48b5-83df-ef29b083952d None None] MFA Rules not processed for user `c41f54152b384425b6c5eae24dc32f04`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:46.429972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63029e9f-dc22-48b5-83df-ef29b083952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:46.467884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:46.495635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1137/2276] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:46.508669 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:46.510162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:46.567517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426c4e-ecfd-4370-8cec-541e386da22f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:46.571793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:46.572390 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:46.572692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:46.572968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:46.582428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:46.583879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:46.593282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1140/2277] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:04:49.779341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b3b8-c2d0-47a7-abbd-d0a08d23db77 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:49.779873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b3b8-c2d0-47a7-abbd-d0a08d23db77 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:49.779873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689b3b8-c2d0-47a7-abbd-d0a08d23db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:49.801185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1689b3b8-c2d0-47a7-abbd-d0a08d23db77 None None] MFA Rules not processed for user `9b1f1832a775468eb737e8be4a6be4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:49.802578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1689b3b8-c2d0-47a7-abbd-d0a08d23db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:49.861575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1138/2278] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:04:56.588953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:04:59.123302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:59.214059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8c70a-6d79-4afc-9075-a85957d865bf service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:59.218732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:59.219362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:59.219694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:59.219978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] PATH_INFO: `/v3/users/c41f54152b384425b6c5eae24dc32f04` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:59.221112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41f54152b384425b6c5eae24dc32f04)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:59.223021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:59.273670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41f54152b384425b6c5eae24dc32f04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:59.286493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41f54152b384425b6c5eae24dc32f04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:59.294525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41f54152b384425b6c5eae24dc32f04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:59.295334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41f54152b384425b6c5eae24dc32f04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:59.296272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41f54152b384425b6c5eae24dc32f04'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:04:59.314945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1141/2279] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:04:59 2022] DELETE /identity/v3/users/c41f54152b384425b6c5eae24dc32f04 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:04:59.319602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:59.320111 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:59.320203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:59.340667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:04:59.341860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:59.406092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1139/2280] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:04:59.416268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:59.417706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:59.478125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2364f08-f711-49c2-b439-1a7d314b7c3f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:59.481801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:59.482398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:59.482677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:59.482948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:59.494438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:59.496022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:04:59.506161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1142/2281] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:04:59.964652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:04:59.966084 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:04:59.977929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e589ce8-8057-4646-b36e-c3d2f3d675b3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:04:59.982491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:04:59.983159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:04:59.983410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:04:59.983700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] PATH_INFO: `/v3/projects/810f4ad2015d4491ba4ea05ff17d4f68` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:04:59.984933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810f4ad2015d4491ba4ea05ff17d4f68)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:04:59.986961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:00.044738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810f4ad2015d4491ba4ea05ff17d4f68', 'request_id': 'req-a3a0b58d-f997-4f79-ba60-0d740f296be0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:00.054702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810f4ad2015d4491ba4ea05ff17d4f68', 'request_id': 'req-a3a0b58d-f997-4f79-ba60-0d740f296be0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:00.063435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810f4ad2015d4491ba4ea05ff17d4f68', 'request_id': 'req-a3a0b58d-f997-4f79-ba60-0d740f296be0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:00.076073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] The token cache is being invalidate because project 810f4ad2015d4491ba4ea05ff17d4f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:05:00.076267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:00.076923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3a0b58d-f997-4f79-ba60-0d740f296be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:00.079457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1140/2282] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:04:59 2022] DELETE /identity/v3/projects/810f4ad2015d4491ba4ea05ff17d4f68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:03.481749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:03.483452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:03.498742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90b24-070a-4124-8514-fa30ddc7f663 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:03.518822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:03.567952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:03.568563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:03.568936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:03.569208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] PATH_INFO: `/v3/users/44d416128cf444efa830d21833eb2610` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:03.570316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d416128cf444efa830d21833eb2610)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:03.573296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:03.627123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d416128cf444efa830d21833eb2610'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:03.640045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d416128cf444efa830d21833eb2610'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:03.646704 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d416128cf444efa830d21833eb2610'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:03.647414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d416128cf444efa830d21833eb2610'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:03.648017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d416128cf444efa830d21833eb2610'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:03.660912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1143/2283] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:05:03 2022] DELETE /identity/v3/users/44d416128cf444efa830d21833eb2610 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:03.665388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:03.665876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:03.665985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:03.679711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:03.689753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:03.689753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:03.753128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1141/2284] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:03.764237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:03.765722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:03.829219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853c5cc-c15e-4cf2-800d-e4a844e8d972 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:03.833254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:03.833862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:03.834144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:03.834415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:03.844108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:03.845573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09563a47-4b05-4096-ac69-1a1524e67353 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:03.855968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1144/2285] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:04.164831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.166343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:04.178120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36955292-c161-4ffd-8cc4-22f09916021b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.182907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.183533 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.183809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.184080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] PATH_INFO: `/v3/projects/2f90e1856aed42e79b0e12648728ee8c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.185213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f90e1856aed42e79b0e12648728ee8c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.187098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.245089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f90e1856aed42e79b0e12648728ee8c', 'request_id': 'req-b10461f0-849c-4843-9a05-468376c3a5d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:04.250736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f90e1856aed42e79b0e12648728ee8c', 'request_id': 'req-b10461f0-849c-4843-9a05-468376c3a5d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:04.259385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f90e1856aed42e79b0e12648728ee8c', 'request_id': 'req-b10461f0-849c-4843-9a05-468376c3a5d2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:04.271235 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] The token cache is being invalidate because project 2f90e1856aed42e79b0e12648728ee8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:05:04.271734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:04.272457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b10461f0-849c-4843-9a05-468376c3a5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:04.274842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1142/2286] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:05:04 2022] DELETE /identity/v3/projects/2f90e1856aed42e79b0e12648728ee8c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:04.279601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.279967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.280514 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.305554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:04.307407 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:04.354057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:04.376733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1145/2287] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:04.389218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.389512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.389789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.418538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:04.419951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:04.428230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1143/2288] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:04.433252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.443313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2179a-fd03-40cc-8ab5-3860502294d2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.448800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.449422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.449707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.450003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.450660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:05:04.450963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.452586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.465136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1146/2289] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:05:04.469419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.478855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636aba9b-71dc-45ba-8959-6b54a01b6df4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.483748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.484348 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.484740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.484937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.485576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.487544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.522215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1144/2290] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:05:04 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:05:04.523329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.533575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eccb70-d014-40fa-85a0-918897ed8ada admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.609632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.610518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.610895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.611269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.611999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.614636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.641434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1147/2291] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:05:04 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:05:04.645453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.656934 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a19e-462a-49cb-a07d-338053bbfbf1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.664299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.665004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.665290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.665563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.666239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.668047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.678571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1145/2292] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:04.683089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.693528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195d6f6-fbea-4a81-9cf8-3d98b66780df admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.698891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.699489 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.699771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.700048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.700758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.702341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cd79e-609f-4727-a99e-a96fb489d22e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.713366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1148/2293] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:04.717523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.728572 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880e11-7790-4537-b173-eff7113835f3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.733745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.734415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.734699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.734974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] PATH_INFO: `/v3/projects/1e406d452b334ef6a1e22bdabeeb537a/users/298641747ee543e997b3c1b5b90a3e71/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.750598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e406d452b334ef6a1e22bdabeeb537a, user_id=298641747ee543e997b3c1b5b90a3e71, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.753319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.766414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1146/2294] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:05:04 2022] PUT /identity/v3/projects/1e406d452b334ef6a1e22bdabeeb537a/users/298641747ee543e997b3c1b5b90a3e71/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:04.777829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8688-e6e2-45c5-b716-b2d8e944adf5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.778146 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8688-e6e2-45c5-b716-b2d8e944adf5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.778422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8688-e6e2-45c5-b716-b2d8e944adf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.806819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2c5f8688-e6e2-45c5-b716-b2d8e944adf5 None None] MFA Rules not processed for user `298641747ee543e997b3c1b5b90a3e71`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:04.808052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2c5f8688-e6e2-45c5-b716-b2d8e944adf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:04.876902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1149/2295] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:04.888170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:04.889918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:04.921160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:04.949532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9427f-225b-4ad5-9664-15927d1835d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:04.953390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:04.954004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:04.954286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:04.954861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:04.963771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:04.965243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:04.974320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1147/2296] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:09.263893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701273ca-0fb5-4e94-a6c4-36a6515c1b42 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:09.264366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701273ca-0fb5-4e94-a6c4-36a6515c1b42 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:09.264658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701273ca-0fb5-4e94-a6c4-36a6515c1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:09.286388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-701273ca-0fb5-4e94-a6c4-36a6515c1b42 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:09.288210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-701273ca-0fb5-4e94-a6c4-36a6515c1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:09.330565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:09.354069 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1150/2297] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:09.396936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:09.399176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:09.476891 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac086801-7b82-4dd1-b2eb-da0d6c48a657 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:09.482050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:09.482965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:09.482965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:09.483189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:09.491956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:09.493885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:09.501864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1148/2298] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:05:18.709008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c64dc-1b6a-45f1-9844-90220981a723 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:18.709619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c64dc-1b6a-45f1-9844-90220981a723 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:18.709619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c64dc-1b6a-45f1-9844-90220981a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:18.730195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-176c64dc-1b6a-45f1-9844-90220981a723 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:18.731406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-176c64dc-1b6a-45f1-9844-90220981a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:18.740168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1151/2299] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:05:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:18.757229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:18.768712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985f9c-9d32-4a3f-ac55-f9895434f3ba service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:18.775011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:18.775719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:18.776142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:18.776462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:18.785392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:18.788566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:18.798126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1149/2300] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:05:22.150774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678c82-7747-42fe-860e-60ca613a26c5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:22.151512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678c82-7747-42fe-860e-60ca613a26c5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:22.151979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678c82-7747-42fe-860e-60ca613a26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:22.238839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-47678c82-7747-42fe-860e-60ca613a26c5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:22.245385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-47678c82-7747-42fe-860e-60ca613a26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:22.399222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1152/2301] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:22.435921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:22.437498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:22.619695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edadd-f7ce-4df5-b5aa-124b133e2f61 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:22.636099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:22.637147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:22.644714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:22.644714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:22.654249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:22.656737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80af9f-eb32-4704-abc0-85011b85ba3a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:22.709792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:22.711281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:22.711743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:22.717767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1150/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:22.763528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] MFA Rules not processed for user `8f75312554114e81a2720c44ffc3ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:22.765580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:22.869398 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1153/2303] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:27.459538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb160d5-6af6-4a7f-8683-69e15762afd2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:27.461816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb160d5-6af6-4a7f-8683-69e15762afd2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:27.462379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb160d5-6af6-4a7f-8683-69e15762afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:27.500201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-acb160d5-6af6-4a7f-8683-69e15762afd2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:27.502005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-acb160d5-6af6-4a7f-8683-69e15762afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:27.524894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1151/2304] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:27.695033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:27.714542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580c97f-6c51-41ef-a18a-6d2b9c4d8b6b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:27.733650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:27.734293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:27.734578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:27.734850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:27.752466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:27.754024 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:27.776032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1154/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:31.887122 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e14-f21c-4b85-9d49-60f8ededea76 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:31.887999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e14-f21c-4b85-9d49-60f8ededea76 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:31.887999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036e14-f21c-4b85-9d49-60f8ededea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:31.907718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4036e14-f21c-4b85-9d49-60f8ededea76 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:31.908958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4036e14-f21c-4b85-9d49-60f8ededea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:31.918252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1152/2306] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:31.952654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:31.965380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b551b0-fad9-42a3-8ac5-7c13905c1c87 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:31.971668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:31.972268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:31.972649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:31.972927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:31.982684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:31.984516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:31.995327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1155/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:35.934043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fdf7-51c6-458e-b64d-465270848dad None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:35.934635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fdf7-51c6-458e-b64d-465270848dad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:35.934951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9fdf7-51c6-458e-b64d-465270848dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:35.942807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:35.956194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-17a9fdf7-51c6-458e-b64d-465270848dad None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:35.957589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-17a9fdf7-51c6-458e-b64d-465270848dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:35.969630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1153/2308] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:35.997370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:36.010072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d7df3-d84d-4418-88c5-05f572d62942 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:36.016038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:36.016689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:36.017375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:36.017719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:36.028070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:36.029689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:36.040598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1156/2309] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:37.684417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:37.685002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:37.685002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:37.706485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:37.707696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:37.715036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1154/2310] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:37.728189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:37.739423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd5548-37a4-46c2-ae5e-8aa82de672eb service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:37.745565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:37.746243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:37.746555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:37.746828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:37.756310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:37.758221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e6c93-83e0-4765-8648-82d082adce96 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:37.766891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1157/2311] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:05:39.808020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:39.809605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:39.837927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba5fce-e311-42f3-8e9f-d2d88dfd2630 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:39.848342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:39.849065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:39.849552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:39.849836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] PATH_INFO: `/v3/users/9b1f1832a775468eb737e8be4a6be4cc` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:39.853045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1f1832a775468eb737e8be4a6be4cc)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:39.856131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:39.921103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1f1832a775468eb737e8be4a6be4cc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:39.929451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1f1832a775468eb737e8be4a6be4cc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:39.930158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1f1832a775468eb737e8be4a6be4cc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:39.930832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1f1832a775468eb737e8be4a6be4cc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:39.938448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1f1832a775468eb737e8be4a6be4cc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:39.960644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1155/2312] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:05:39 2022] DELETE /identity/v3/users/9b1f1832a775468eb737e8be4a6be4cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:40.142918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.143480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.143480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.153127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:40.168025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:40.169258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.195562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.197727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.270873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1158/2313] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:40.297222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94676cf-b325-4ccb-96a4-d8e26fa21d18 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.297660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.299029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.302107 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.302743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.303022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.303292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] PATH_INFO: `/v3/projects/ccbd369a16c34f1284879f4e9390b5f4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.304668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbd369a16c34f1284879f4e9390b5f4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.306736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.359852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbd369a16c34f1284879f4e9390b5f4', 'request_id': 'req-090f2a17-1630-49dc-882e-807cf7701828'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:40.365957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbd369a16c34f1284879f4e9390b5f4', 'request_id': 'req-090f2a17-1630-49dc-882e-807cf7701828'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:40.370845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:40.376090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbd369a16c34f1284879f4e9390b5f4', 'request_id': 'req-090f2a17-1630-49dc-882e-807cf7701828'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:40.380943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767856-701e-419e-8354-0b4ce11177b9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.401931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] The token cache is being invalidate because project ccbd369a16c34f1284879f4e9390b5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:05:40.402221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:40.402884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-090f2a17-1630-49dc-882e-807cf7701828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:40.404919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1156/2314] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:05:40 2022] DELETE /identity/v3/projects/ccbd369a16c34f1284879f4e9390b5f4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:40.409453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c04-6a35-4efe-b905-bfaaf8880298 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.409737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c04-6a35-4efe-b905-bfaaf8880298 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.410006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b78c04-6a35-4efe-b905-bfaaf8880298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.436239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-02b78c04-6a35-4efe-b905-bfaaf8880298 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:40.437584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-02b78c04-6a35-4efe-b905-bfaaf8880298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.483828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.484222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.484530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.484809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.487179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.539999 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:40.543052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1157/2315] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:40.558956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.559223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.559540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.585919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:40.587421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:40.587575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.590794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.597033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1158/2316] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:40.601724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.605780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1159/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:40.614455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f346c54-a7b4-4539-aa39-dc2445f16d2f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.622021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.622635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.622914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.623183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.623866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:05:40.624168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.625801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.638997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1159/2318] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:05:40.642886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.659192 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d4029-ab9f-4d57-aac8-e8efd8216be9 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.664588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.665272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.665635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.665914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.666639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.668726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.708523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1160/2319] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:05:40.711292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.721754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8aab4f-c4f4-4395-a18e-d41bf586c3d1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.797350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.798408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.798900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.799398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.800549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.804995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.833722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1160/2320] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:05:40 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:05:40.838259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.849066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80492-d607-4855-bc58-cfda8746de45 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.855243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.856009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.856198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.856400 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.857534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.860252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.880705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1161/2321] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:05:40.882566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.892668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fe5-f448-4554-858d-d1e885f12856 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.898058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.898679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.898957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.899227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.899870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.901589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078c0f-98ef-4907-b0c9-04cff67ce8e4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:40.915583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1161/2322] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:40.920566 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:40.946275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1676d-6e66-4c88-a658-1caf5b6a26f8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:40.962953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:40.963635 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:40.963920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:40.964200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] PATH_INFO: `/v3/projects/4e4a5106e3844d92ae02ed37e21bf2ed/users/6f84c15f7af147a3a6e2813bfb49ebc5/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:40.983298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4a5106e3844d92ae02ed37e21bf2ed, user_id=6f84c15f7af147a3a6e2813bfb49ebc5, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:40.986022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:41.002932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1162/2323] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:05:40 2022] PUT /identity/v3/projects/4e4a5106e3844d92ae02ed37e21bf2ed/users/6f84c15f7af147a3a6e2813bfb49ebc5/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:05:41.013411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:41.013748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:41.013979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:41.047200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] MFA Rules not processed for user `6f84c15f7af147a3a6e2813bfb49ebc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:41.048435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:41.110018 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:41.137875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1162/2324] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:41.150519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:41.152306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:41.208321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dbcb-215f-4212-9ebe-3ce12debc94a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:41.212591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:41.213193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:41.213472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:41.213742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:41.222234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:41.223654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232095f-ceb6-488b-919f-4717894f2a17 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:41.233408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1163/2325] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:43.875690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:43.974817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47edab9-fb5f-42d6-a522-a2c0be22d86f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:43.983851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:43.984523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:43.984804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:43.985075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] PATH_INFO: `/v3/users/6f84c15f7af147a3a6e2813bfb49ebc5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:43.986198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f84c15f7af147a3a6e2813bfb49ebc5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:43.988182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:44.050276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f84c15f7af147a3a6e2813bfb49ebc5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.061375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f84c15f7af147a3a6e2813bfb49ebc5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.062104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f84c15f7af147a3a6e2813bfb49ebc5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.062868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f84c15f7af147a3a6e2813bfb49ebc5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.071549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f84c15f7af147a3a6e2813bfb49ebc5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.091957 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1163/2326] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:05:43 2022] DELETE /identity/v3/users/6f84c15f7af147a3a6e2813bfb49ebc5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:44.096816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.097329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.097683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.122851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:44.124244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:44.203615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1164/2327] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:44.213814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:44.215470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:44.290591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94b244-1802-40fb-8b04-fc69d7df1d06 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:44.294360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:44.294980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.295264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.295536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.306557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:44.308299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb23dcc-5d2d-4a02-8a2d-0e9900429ad6 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:44.321506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1164/2328] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:44.678396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:44.681316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:44.695303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be6c5-fa63-43a6-a99c-f43d8dab3320 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:44.710143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:44.710845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.711135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.711773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] PATH_INFO: `/v3/projects/4e4a5106e3844d92ae02ed37e21bf2ed` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.712716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4a5106e3844d92ae02ed37e21bf2ed)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:44.714805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:44.734042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:44.768636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4a5106e3844d92ae02ed37e21bf2ed', 'request_id': 'req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.775352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4a5106e3844d92ae02ed37e21bf2ed', 'request_id': 'req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.782184 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4a5106e3844d92ae02ed37e21bf2ed', 'request_id': 'req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.795953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] The token cache is being invalidate because project 4e4a5106e3844d92ae02ed37e21bf2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:05:44.796245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.796900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eb620d33-cf97-4cd5-8b4f-c6448ce5c0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:44.798421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1165/2329] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:05:44 2022] DELETE /identity/v3/projects/4e4a5106e3844d92ae02ed37e21bf2ed => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:44.803164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.803449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.803721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.812027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:44.827335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:44.828753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:44.900354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1165/2330] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:44.908224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.908786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.909278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.931499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:44.932774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:44.944455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1166/2331] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:44.954234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:44.964965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad2fbb-f097-47ed-8d48-3d5230898cdc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:44.969778 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:44.970389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:44.970652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:44.970924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:44.971872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:05:44.971872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:44.973488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:44.987180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1166/2332] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:05:44.991501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.002492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d10ecc-1e56-438e-8cdf-9d97dd4b2eee None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.007348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.008083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.008331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.008656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.009288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.011166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.041832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1167/2333] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:05:44 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:05:45.046423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.057000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befbaca-b86c-40a6-84db-aba76caed19d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.124301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.124972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.125254 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.125532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.126155 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.128055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.150371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1167/2334] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:05:45 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:05:45.154592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.165887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490cef4-5c9c-4250-9acc-d4559f7b58a1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.170839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.171444 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.171722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.172168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.172849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.174466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.187140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1168/2335] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:45.191267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.203467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff1190-ef85-45ee-bc5b-120cc09eda04 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.208861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.209482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.209836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.210075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.211759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.213799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db6dc90-5090-4525-a197-948c74c4b046 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.227257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1168/2336] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:45.231375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.248317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845ae2e-feb0-454e-9bbc-999973382dee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.253285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.253947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.254230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.255289 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] PATH_INFO: `/v3/projects/177a1d80f40f48678adeda2a9ebb9549/users/29ab4652d4f949cc91486bfe6fd96844/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.278392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=177a1d80f40f48678adeda2a9ebb9549, user_id=29ab4652d4f949cc91486bfe6fd96844, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.281063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8139b-6df5-4a31-a007-492a23425fee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.297216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1169/2337] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:05:45 2022] PUT /identity/v3/projects/177a1d80f40f48678adeda2a9ebb9549/users/29ab4652d4f949cc91486bfe6fd96844/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:45.310129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.310430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.310683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.362626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] MFA Rules not processed for user `29ab4652d4f949cc91486bfe6fd96844`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:45.363938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.459624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca527-96cc-4f91-9479-50720e75d285 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.459911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca527-96cc-4f91-9479-50720e75d285 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.460182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ca527-96cc-4f91-9479-50720e75d285 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.462647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1170/2338] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 17:05:45.469146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:45.470475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.470935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.471405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.479537 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1169/2339] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:45.494227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:45.494773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.495907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.496296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.571701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7f23-c15f-45ad-a522-2233e00d385d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.576710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.577451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.577832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.578205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.589199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.590643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325d737-09c5-43e5-8c3e-c95ff03b30b2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.598865 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1171/2340] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:45.601069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1170/2341] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:45.611688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.613561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.657327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:45.688728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d2ae9-f8d8-46d8-80bf-9bab8c062fb6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.695664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.696523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.696984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.697357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.708646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.710135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42e490-a1de-41b5-91c9-172ccf9b34e8 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.724369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1172/2342] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:45.802441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.803349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.803349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.805064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1171/2343] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:05:45.810442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694f0e-2ba4-43b3-9c2b-d9993db1ff6d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.810733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694f0e-2ba4-43b3-9c2b-d9993db1ff6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.811014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694f0e-2ba4-43b3-9c2b-d9993db1ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.831846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a694f0e-2ba4-43b3-9c2b-d9993db1ff6d None None] MFA Rules not processed for user `faba61a963e149c3a09e17bed3c2ce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:45.833308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a694f0e-2ba4-43b3-9c2b-d9993db1ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.907348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1173/2344] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:45.934104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:45.937090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:45.956721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bebff6-bedb-4d58-b964-335ffdf44d65 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:45.971401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:45.972283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:45.972636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:45.972992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:45.983652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:45.985329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce1dee-1751-4357-bac9-b471fa5d898c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:45.996404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1172/2345] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:46.206674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:46.207153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:46.207867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:46.210420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1174/2346] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:05:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:05:46.216967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdacf-7872-4771-b48c-a8703d2cd7eb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:46.217271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdacf-7872-4771-b48c-a8703d2cd7eb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:46.217549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdacf-7872-4771-b48c-a8703d2cd7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:46.237580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8ecbdacf-7872-4771-b48c-a8703d2cd7eb None None] MFA Rules not processed for user `ca316ae3b4d84309af586fbb5aa61dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:46.238769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8ecbdacf-7872-4771-b48c-a8703d2cd7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:46.248861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1173/2347] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:46.260507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:46.266345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:46.289614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851eea4-c4b4-4f4a-b503-cbb0acb34258 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:46.293414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:46.294021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:46.294307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:46.294581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:46.307279 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:46.308680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:46.319318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1175/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:47.469583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ee46-a166-4ea5-ae2d-75f326c5c6ab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:47.470884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ee46-a166-4ea5-ae2d-75f326c5c6ab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:47.471386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653ee46-a166-4ea5-ae2d-75f326c5c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:47.498304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8653ee46-a166-4ea5-ae2d-75f326c5c6ab None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:47.499639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8653ee46-a166-4ea5-ae2d-75f326c5c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:47.590052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1174/2349] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:47.624818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:47.626419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:47.641156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435422-2857-4962-bd4a-85f9135401bc service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:47.646838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:47.647433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:47.647732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:47.648048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:47.657659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:47.659250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:47.673025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1176/2350] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:51.915360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:51.915874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:51.916113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:51.949424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:51.950650 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:52.036520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1175/2351] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:52.051672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:52.053445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:52.137666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a55d4-5329-459d-a41a-27164a35fd8e service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:52.143158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:52.143886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:52.144301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:52.144771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:52.155966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:52.157727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b11d5e-0575-4312-9e6f-d647b9cf9c3f service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:52.168961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1177/2352] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:05:56.361545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:56.374182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7258425-6c1d-4064-9ce5-a2980022254c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:56.379047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:56.379785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:56.380139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:56.380510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] PATH_INFO: `/v3/users/29ab4652d4f949cc91486bfe6fd96844` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:56.381732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ab4652d4f949cc91486bfe6fd96844)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:56.384456 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:56.410966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:56.443282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ab4652d4f949cc91486bfe6fd96844'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:56.452141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ab4652d4f949cc91486bfe6fd96844'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:56.452933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ab4652d4f949cc91486bfe6fd96844'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:56.453580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ab4652d4f949cc91486bfe6fd96844'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:56.462417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ab4652d4f949cc91486bfe6fd96844'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:56.483944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1176/2353] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:05:56 2022] DELETE /identity/v3/users/29ab4652d4f949cc91486bfe6fd96844 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:56.488517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:56.489009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:56.489108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:56.510695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:56.512319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:56.557321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:56.576066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1178/2354] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:05:56.586013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:56.587713 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:56.645488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fc259-0146-41d1-a9c1-9c31d21b791b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:56.649103 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:56.649831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:56.650145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:56.650421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:56.659561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:56.661030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a3bac-8da5-44f6-9f64-972fc16f2935 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:56.670994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1177/2355] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:05:56.944575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:56.946937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:56.960896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a61d7-e602-4769-975b-e21ad898f78a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:56.965979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:56.967212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:56.968112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:56.968619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] PATH_INFO: `/v3/projects/177a1d80f40f48678adeda2a9ebb9549` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:56.969958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=177a1d80f40f48678adeda2a9ebb9549)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:56.972359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.021783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177a1d80f40f48678adeda2a9ebb9549', 'request_id': 'req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:57.027402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177a1d80f40f48678adeda2a9ebb9549', 'request_id': 'req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:57.034137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177a1d80f40f48678adeda2a9ebb9549', 'request_id': 'req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:57.046448 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] The token cache is being invalidate because project 177a1d80f40f48678adeda2a9ebb9549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:05:57.046740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:57.047362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-484f27bb-637a-4f9d-a23f-d678c6f4cf0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:57.048872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1179/2356] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:05:56 2022] DELETE /identity/v3/projects/177a1d80f40f48678adeda2a9ebb9549 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:05:57.053829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.054123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.054401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.074825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:57.075956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:57.134340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1178/2357] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:57.142320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.142613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.143032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.162856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:57.164130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:57.173018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1180/2358] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:57.177257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.187011 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731a85-20e3-4345-99a2-a5300e1b6a5f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.191627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.192226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.192531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.192807 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.193485 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:05:57.193803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.195381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.207658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1179/2359] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:05:57.212456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.221525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0b508-09f2-49c0-a686-1fabc1900b47 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.226177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.226762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.227039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.227325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.228117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.230134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.261843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1181/2360] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:05:57 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:05:57.262920 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.273566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14531cc-5924-4f24-b7dd-4734cbe471d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.304746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:57.339545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.340156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.340438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.340895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.341398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.343315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.371463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1180/2361] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:05:57 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:05:57.375735 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.387376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27000d07-ad0d-4ce3-9279-b1ee274f3aa2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.392964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.393560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.393836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.394106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.394744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.396372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.407172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1182/2362] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:57.411100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.421088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9d502-94a7-4d1e-9c50-f93bd6776ea5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.425671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.426261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.426538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.426808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.427459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.429078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48057240-cf3c-4b56-ab8f-ee7e5125f7c0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.439450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1181/2363] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:05:57.443513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.454007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce2ee6-b7a4-4efa-bcdf-6cf8b36edd4a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.458864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.459508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.459785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.460057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] PATH_INFO: `/v3/projects/7c8b0b42c7084e06941b3d5a9cbca804/users/084a7ba60a144db9aa774e512c92749d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.475405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8b0b42c7084e06941b3d5a9cbca804, user_id=084a7ba60a144db9aa774e512c92749d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.478338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.494997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1183/2364] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:05:57 2022] PUT /identity/v3/projects/7c8b0b42c7084e06941b3d5a9cbca804/users/084a7ba60a144db9aa774e512c92749d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:57.508143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.508424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.509349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.539176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] MFA Rules not processed for user `084a7ba60a144db9aa774e512c92749d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:57.541653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:57.615300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1182/2365] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:57.628079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:57.630543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:57.704829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb71d-fef4-41d9-ab49-30d62eb54426 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:57.708802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:57.709523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:57.709932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:57.710287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:57.720543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:57.722050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc7ee4-1f3f-4e8a-856b-f69b39cf1dc8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:57.732057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1184/2366] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:05:59.539662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:59.541900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:59.614552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17434a7b-3bfd-47fb-aaf6-aa74ccbfb693 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:59.620984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:59.621723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:59.622124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:59.622621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] PATH_INFO: `/v3/users/298641747ee543e997b3c1b5b90a3e71` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:59.624026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298641747ee543e997b3c1b5b90a3e71)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:59.626112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:59.692185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:59.700803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298641747ee543e997b3c1b5b90a3e71'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:59.713834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298641747ee543e997b3c1b5b90a3e71'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:59.714664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298641747ee543e997b3c1b5b90a3e71'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:59.715358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298641747ee543e997b3c1b5b90a3e71'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:59.723291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298641747ee543e997b3c1b5b90a3e71'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:05:59.752669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1183/2367] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:05:59 2022] DELETE /identity/v3/users/298641747ee543e997b3c1b5b90a3e71 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:05:59.757368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:59.757851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:59.757947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:59.779854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:05:59.781108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:59.785889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:05:59.849116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1185/2368] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:05:59.859278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:05:59.860786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:05:59.924090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc6578-87ff-4b9a-bec6-49016c8fa023 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:05:59.928005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:05:59.928676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:05:59.928954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:05:59.929220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:05:59.938846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:05:59.940277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:05:59.950876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1184/2369] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:00.425798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:00.427236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:00.449593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64e69-1486-4003-ba39-0c4fb2ebea7f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:00.458931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:00.460075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:00.461017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:00.462506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] PATH_INFO: `/v3/projects/1e406d452b334ef6a1e22bdabeeb537a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:00.466050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e406d452b334ef6a1e22bdabeeb537a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:00.468109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:00.576251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e406d452b334ef6a1e22bdabeeb537a', 'request_id': 'req-eae25279-5c3b-4f4c-922a-53ea5d914b8c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:00.584830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e406d452b334ef6a1e22bdabeeb537a', 'request_id': 'req-eae25279-5c3b-4f4c-922a-53ea5d914b8c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:00.602145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e406d452b334ef6a1e22bdabeeb537a', 'request_id': 'req-eae25279-5c3b-4f4c-922a-53ea5d914b8c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:00.628043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] The token cache is being invalidate because project 1e406d452b334ef6a1e22bdabeeb537a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:06:00.628658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:00.629697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eae25279-5c3b-4f4c-922a-53ea5d914b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:00.631431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1186/2370] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:06:00 2022] DELETE /identity/v3/projects/1e406d452b334ef6a1e22bdabeeb537a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:06:02.964381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:02.965905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:02.981261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f62b-a71c-4ddb-901a-48729472991c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:03.049651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:03.050589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:03.050810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:03.051164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] PATH_INFO: `/v3/users/084a7ba60a144db9aa774e512c92749d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:03.052304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084a7ba60a144db9aa774e512c92749d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:03.054782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:03.135078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084a7ba60a144db9aa774e512c92749d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.148025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084a7ba60a144db9aa774e512c92749d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.149567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084a7ba60a144db9aa774e512c92749d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.150463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084a7ba60a144db9aa774e512c92749d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.157140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:03.160052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084a7ba60a144db9aa774e512c92749d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.196546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1185/2371] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:06:02 2022] DELETE /identity/v3/users/084a7ba60a144db9aa774e512c92749d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:06:03.201373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:03.201958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:03.201958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:03.229765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:03.231134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:03.308168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1187/2372] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:06:03.318511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:03.320185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:03.394397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6990a37-123c-44b4-9888-5bcc2398b807 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:03.398498 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:03.399592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:03.399978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:03.400352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:03.410100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:03.411534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60e824-6869-4216-8455-77baf54c77bc service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:03.421521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1186/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:06:03.822061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:03.823570 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:03.842484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83214aef-c62a-4525-8dbd-de12d40e7e9e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:03.847892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:03.849018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:03.849195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:03.849599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] PATH_INFO: `/v3/projects/7c8b0b42c7084e06941b3d5a9cbca804` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:03.850864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8b0b42c7084e06941b3d5a9cbca804)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:03.855770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:03.929945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:03.954836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8b0b42c7084e06941b3d5a9cbca804', 'request_id': 'req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.968046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8b0b42c7084e06941b3d5a9cbca804', 'request_id': 'req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.981820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8b0b42c7084e06941b3d5a9cbca804', 'request_id': 'req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.997241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] The token cache is being invalidate because project 7c8b0b42c7084e06941b3d5a9cbca804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:06:03.997664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:03.998640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d47a2ff8-8f16-4c2e-9434-55e3ec5e4c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:06:04.000513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1188/2374] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:06:03 2022] DELETE /identity/v3/projects/7c8b0b42c7084e06941b3d5a9cbca804 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:06:04.005361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.005962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.006172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.036027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:04.037299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:04.105227 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1187/2375] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:06:04.112919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.113420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.113816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.134873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:04.136187 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:04.144291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1189/2376] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:06:04.148639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.159293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73bf96-39ed-4e13-9c31-2f4b35ce492a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.164060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.164974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.165296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.165571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.166231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:06:04.166548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.168167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.184038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1188/2377] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:06:04.185796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.195412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5c070-ea96-4179-8fcd-f7a2cbf51538 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.201802 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.202555 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.202926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.203217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.203938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.206625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.248133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1190/2378] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:06:04.249382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.261167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ede48-c265-4dc3-b50e-64f05976f550 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.353136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.354164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.354691 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.355185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.355928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.357991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.376230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:04.387487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1189/2379] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:06:04 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:06:04.388062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.399709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc620a-1313-4aa7-903d-cd7ac2e68838 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.405402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.405893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.406249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.406528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.412918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.415242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.426465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1191/2380] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:06:04.430688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.441729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dff4e-0d1c-49cf-aeda-7f15bbedbca5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.448091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.448750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.449032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.449304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.449953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.452012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c2934-5203-41dc-97bb-2758384210c5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.465140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1190/2381] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:06:04.468954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.480422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fd5ea-fd53-492e-bc8f-30f5f48b1e43 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.487067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.487885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.488168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.488443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] PATH_INFO: `/v3/projects/b8ab524ebcc444ca8bd3e4a261b1ea57/users/463bcb98107f409db2fe6248107d6d0d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.515362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ab524ebcc444ca8bd3e4a261b1ea57, user_id=463bcb98107f409db2fe6248107d6d0d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.527176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.548845 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1192/2382] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:06:04 2022] PUT /identity/v3/projects/b8ab524ebcc444ca8bd3e4a261b1ea57/users/463bcb98107f409db2fe6248107d6d0d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:06:04.550205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b1b2-e456-4072-be9b-29f38c1f471a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.550654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b1b2-e456-4072-be9b-29f38c1f471a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.550990 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b1b2-e456-4072-be9b-29f38c1f471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.576398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9138b1b2-e456-4072-be9b-29f38c1f471a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:04.577917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9138b1b2-e456-4072-be9b-29f38c1f471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:04.644688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1191/2383] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:06:04.664143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:04.666825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:04.730886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d476c1a-7f09-4198-8154-d2c391fbf756 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:04.734497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:04.735103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:04.735384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:04.735656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:04.744758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:04.746203 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:04.757265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1193/2384] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:09.695435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:09.696062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:09.696062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:09.759022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] MFA Rules not processed for user `463bcb98107f409db2fe6248107d6d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:09.761457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:09.839495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1192/2385] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:09.857302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:09.872947 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605c38e-ee23-4c05-8e20-b578744b7f22 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:09.877918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:09.878532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:09.878813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:09.879091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:09.879900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:09.881945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:09.917031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1194/2386] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:06:09 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:06:09.932752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:09.942483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08623b7-7d69-4be6-ac49-7acfb43b2fb2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:10.011178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:10.011859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:10.012086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:10.012951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:10.013693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:10.015729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:10.045184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1193/2387] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:06:09 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:06:10.047680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:10.059208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868ad7a-5491-4c5b-a8df-b705ef03bdc0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:10.065674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:10.066293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:10.066572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:10.066844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:10.067525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:10.069159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:10.092605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1195/2388] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:06:10.098772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:10.110651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdc32d-aa16-4067-bd68-9a6c67dd0237 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:10.115803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:10.116571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:10.116864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:10.117149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] PATH_INFO: `/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e/users/e97025dbce7b425aa717eacc2bf57671/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:10.123830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:10.143324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7ff7aeffe46658b2d041c61633e3e, user_id=e97025dbce7b425aa717eacc2bf57671, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:10.146063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:10.172801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1194/2389] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:06:10 2022] PUT /identity/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e/users/e97025dbce7b425aa717eacc2bf57671/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:06:10.176800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:10.192155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc9b0a-7d6c-46f9-b010-efdb99538e3c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:10.237580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:10.338404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:10.339027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:10.339314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:10.339612 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:10.340237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:10.342105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:10.354974 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1196/2390] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:06:10.359358 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:10.376853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bed29-5bb0-42df-b8e9-0520003b9999 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:10.388780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:10.389752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:10.390110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:10.390432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] PATH_INFO: `/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e/users/e97025dbce7b425aa717eacc2bf57671/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:10.393158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf7ff7aeffe46658b2d041c61633e3e, user_id=e97025dbce7b425aa717eacc2bf57671, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:10.395834 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445da928-d28c-4ee1-acee-41870af11436 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:10.413032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1195/2391] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:06:10 2022] PUT /identity/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e/users/e97025dbce7b425aa717eacc2bf57671/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:06:11.261605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:11.263587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:11.346066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97af8c-a8b1-4fba-aa7b-9610e9e42d5e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:11.419870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:11.420510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:11.420816 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:11.421092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:11.422928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:11.439672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:11.443260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:11.460290 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1197/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:16.698357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984347-b204-47ad-8ab4-534cc464d34c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:16.701945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984347-b204-47ad-8ab4-534cc464d34c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:16.702185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3984347-b204-47ad-8ab4-534cc464d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:16.745413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b3984347-b204-47ad-8ab4-534cc464d34c None None] MFA Rules not processed for user `e97025dbce7b425aa717eacc2bf57671`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:16.746689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b3984347-b204-47ad-8ab4-534cc464d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:16.825014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1196/2393] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:16.839691 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:16.841665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:16.903465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bafe0-a2a3-4020-9926-d72d23c9e446 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:16.907495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530609a984b24349a028bcf07ae290ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:16.908097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:16.908374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:16.908675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:16.912789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:16.978483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:16.979920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:16.988875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1198/2394] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:17.118374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303050e-02bb-4f32-9f08-fc48b525642d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:17.118779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303050e-02bb-4f32-9f08-fc48b525642d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:17.118981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303050e-02bb-4f32-9f08-fc48b525642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:17.139702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c303050e-02bb-4f32-9f08-fc48b525642d None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:17.140959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c303050e-02bb-4f32-9f08-fc48b525642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:17.222443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1197/2395] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:17.245455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:17.247058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:17.364513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9c7e5-8464-43d5-888d-127d46c693cd service glance] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:17.375234 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:17.375862 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:17.376174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:17.376412 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:17.387747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:17.389698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac25acc-bfa5-4188-b976-7bd24abd300f service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:17.400324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1199/2396] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:06:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:06:17.680474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:17.680825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:17.681060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:17.718300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] MFA Rules not processed for user `fa935d6a0e814506a9ac2f168a058aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:17.720518 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:17.806690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1198/2397] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:19.516972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351c01-a7c5-4d31-9ba1-3d8295f1d198 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:19.517519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351c01-a7c5-4d31-9ba1-3d8295f1d198 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:19.517632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c351c01-a7c5-4d31-9ba1-3d8295f1d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:19.543579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8c351c01-a7c5-4d31-9ba1-3d8295f1d198 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:19.545018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8c351c01-a7c5-4d31-9ba1-3d8295f1d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:19.553650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1200/2398] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:19.587214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:19.595316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:19.603037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3e8c5-5c8b-4ae0-af6b-79103a4c62ff None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:19.613244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:19.614082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:19.614655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:19.614933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:19.627101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:19.629511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f336e-2354-4fda-92dc-46a210c15e8e service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:19.646272 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1199/2399] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:06:27.404101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:27.404598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:27.404706 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:27.424063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] MFA Rules not processed for user `463bcb98107f409db2fe6248107d6d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:27.425295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:27.432744 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1201/2400] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:06:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:29.641157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:29.676097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd898-d815-4ee9-9b80-7e906a5c4fc6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:29.676388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd898-d815-4ee9-9b80-7e906a5c4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:29.676712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afd898-d815-4ee9-9b80-7e906a5c4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:29.705388 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-37afd898-d815-4ee9-9b80-7e906a5c4fc6 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:29.706517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37afd898-d815-4ee9-9b80-7e906a5c4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:29.715913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1200/2401] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:06:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:29.730965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:29.747363 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08be16e-b6bb-4c0b-b037-c93d63b6adeb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:29.753600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:29.754206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:29.754658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:29.754930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:29.764682 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:29.766547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:29.775956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1202/2402] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:06:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:06:39.699795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:39.771620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=69 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:06:45.620203 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860f4dc-c885-4b2b-a72e-c6be43de0ce5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:45.620798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860f4dc-c885-4b2b-a72e-c6be43de0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:45.620798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860f4dc-c885-4b2b-a72e-c6be43de0ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:45.641621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b860f4dc-c885-4b2b-a72e-c6be43de0ce5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:45.642838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b860f4dc-c885-4b2b-a72e-c6be43de0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:45.708867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1201/2403] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:45.740795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:45.742899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:45.817830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57fe09-0474-4de2-a1e1-1303181dd379 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:45.824455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:45.825097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:45.825378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:45.825646 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:45.834293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:45.835919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:45.846089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1203/2404] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:49.912145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcc860-bb85-4f26-8aba-2db2d0e97003 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:49.912719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcc860-bb85-4f26-8aba-2db2d0e97003 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:49.912845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcc860-bb85-4f26-8aba-2db2d0e97003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:49.931539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1cfcc860-bb85-4f26-8aba-2db2d0e97003 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:49.932758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1cfcc860-bb85-4f26-8aba-2db2d0e97003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:49.940517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1202/2405] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:49.971878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:49.983281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1123f52-189b-4fb8-a3a9-87dff0c5b267 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:49.988720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:49.989297 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:49.989573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:49.989841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:49.998622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:50.000172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:50.010217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1204/2406] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:54.008037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:54.008570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:54.008861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:54.030189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:54.031402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:54.039701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1203/2407] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:06:54.077241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:54.088837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a345e94-21f7-48d6-ac99-3f3b07c88577 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:54.094993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:54.095595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:54.095872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:54.096139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:54.105393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:54.106958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f42da-f1e5-43ff-95af-1c6e751f4f6c service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:54.118227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1205/2408] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:56.423153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:56.424610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:56.485968 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715d40-d63c-4fcf-8553-7e10b6682464 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:56.489477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:56.490073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:56.490351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:56.490618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:56.499915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:56.501375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:56.510789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1204/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:06:58.228846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820f2d-7f44-4e1d-9624-a96f9d89131d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:58.229332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820f2d-7f44-4e1d-9624-a96f9d89131d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:58.229440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13820f2d-7f44-4e1d-9624-a96f9d89131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:58.251174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-13820f2d-7f44-4e1d-9624-a96f9d89131d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:06:58.252421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-13820f2d-7f44-4e1d-9624-a96f9d89131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:58.261309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1206/2410] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:06:58.291396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:06:58.292914 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:06:58.314814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45c666-69cc-49fb-9f1f-eb44cc166808 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:06:58.323246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:06:58.326791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:06:58.327290 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:06:58.327773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:06:58.338242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:06:58.340153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:06:58.353049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1205/2411] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:02.416882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43f60-d8ea-4016-9d08-6cc67d745241 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:02.417432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43f60-d8ea-4016-9d08-6cc67d745241 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:02.417532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43f60-d8ea-4016-9d08-6cc67d745241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:02.436708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6ac43f60-d8ea-4016-9d08-6cc67d745241 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:07:02.437889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6ac43f60-d8ea-4016-9d08-6cc67d745241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:02.446191 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1207/2412] 10.222.0.13 () {58 vars in 1016 bytes} [Wed Aug 10 17:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:07:02.471149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:07:02.482579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e7b3-8ce3-4119-80c5-a061d4f362b1 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:07:02.488043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:07:02.488670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:02.488942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:02.489214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:02.497773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:07:02.499331 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:07:02.509566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1206/2413] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:12.432307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=52 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:12.504493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=71 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:22.468930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:22.469523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:22.469609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:22.489761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] MFA Rules not processed for user `955e27b73d0f42698dcb99d7f3be3178`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:07:22.491092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:22.548466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1208/2414] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:07:32.540509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=25 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:36.084681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:07:36.086720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:36.101450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736ebf-c189-44a0-b8e5-13eee84eff3b service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:07:36.109385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:07:36.110112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:36.110545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:36.111215 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] PATH_INFO: `/v3/users/fa935d6a0e814506a9ac2f168a058aae` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:36.112433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa935d6a0e814506a9ac2f168a058aae)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:07:36.115680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:07:36.174217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa935d6a0e814506a9ac2f168a058aae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.182608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa935d6a0e814506a9ac2f168a058aae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.183407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa935d6a0e814506a9ac2f168a058aae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.184040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa935d6a0e814506a9ac2f168a058aae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.191534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-46bb18ae-4898-42f3-bce5-94e0ea726b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa935d6a0e814506a9ac2f168a058aae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.209409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1207/2415] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:07:36 2022] DELETE /identity/v3/users/fa935d6a0e814506a9ac2f168a058aae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:07:36.397003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:07:36.431225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3ebe-5324-4f8d-aa20-88ce59781f37 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:07:36.494119 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:07:36.494996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:36.495273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:36.495543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] PATH_INFO: `/v3/projects/50a0d3a8f796403bb117893265c19061` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:36.496746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a0d3a8f796403bb117893265c19061)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:07:36.498671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:07:36.550618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a0d3a8f796403bb117893265c19061', 'request_id': 'req-c69243ba-45d7-4fd1-8020-6f68a0ef2103'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.556674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a0d3a8f796403bb117893265c19061', 'request_id': 'req-c69243ba-45d7-4fd1-8020-6f68a0ef2103'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.563484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a0d3a8f796403bb117893265c19061', 'request_id': 'req-c69243ba-45d7-4fd1-8020-6f68a0ef2103'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.576762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] The token cache is being invalidate because project 50a0d3a8f796403bb117893265c19061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:07:36.577049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.577738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:07:36.579305 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1209/2416] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:07:36 2022] DELETE /identity/v3/projects/50a0d3a8f796403bb117893265c19061 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:07:39.710817 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:39.711317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:39.711423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:39.731305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] MFA Rules not processed for user `8f75312554114e81a2720c44ffc3ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:07:39.732470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:39.785336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1208/2417] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:07:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:07:46.572902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:49.778662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:07:51.028567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:07:51.029996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:51.085817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69243ba-45d7-4fd1-8020-6f68a0ef2103 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:07:51.089952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:07:51.090544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:51.090824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:51.091095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:51.092797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:51.161536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:07:51.162993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d016-2654-4e7e-a7e8-22a94110965c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:07:51.173851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1210/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:55.316303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:07:55.317818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:55.329996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87962ce7-7d37-4561-94c3-380859c9ab0d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:07:55.334071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:07:55.334747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:55.335063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:55.335337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:55.337127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:55.351985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:07:55.354322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:07:55.367191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1209/2419] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:07:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:07:56.661988 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:07:56.662439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:07:56.662549 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:07:56.683894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] MFA Rules not processed for user `508fe245e731449da94b0a7abf895f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:07:56.685135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:07:56.750384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1211/2420] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:07:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:01.829243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:01.830836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:01.844626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526144f7-c426-4649-9076-e035759b8dcb service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:01.850110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:01.850705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:01.850983 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:01.851255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:01.853510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:01.863830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:01.865436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:01.874936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1210/2421] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:06.740283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=79 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:11.871005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=12 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:22.712492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:22.713888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:22.771666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75fea1-d296-4467-8a2c-0a9bf69d7293 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:22.775273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:22.775868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:22.776145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:22.776413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:22.778879 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:22.789830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:22.791239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:22.800507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1212/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:30.737069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:30.757439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efcbd-2a89-4fdc-95ab-cfeaca0675e4 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:30.775663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:30.776393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:30.776774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:30.777123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:30.780230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:30.796160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:30.797839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:30.819660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1211/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:32.796215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=26 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:39.198668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:39.213214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447f1c0-204d-4ce7-a059-22aa2644867f service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:39.219534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:39.220148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:39.220427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:39.220739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:39.222529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:39.293283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:39.295456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:39.305820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1213/2424] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:40.804399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:43.263300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:43.276446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d97e8-973c-4d2c-a3d7-88128c8e12f5 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:43.282351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:43.285581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:43.286082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:43.286562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:43.290109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:43.302033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:43.303656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19477d2-6f46-4e5a-b5e8-645bd0f02920 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:43.317220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1212/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:46.464091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:46.476350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae1c8-48c8-47f2-9dea-6f7d49e44527 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:46.480421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:46.481072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:46.481350 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:46.481622 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:46.484280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:46.570317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:46.571794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffd0d9-1cc1-4d8d-869c-ea6ed76c776e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:46.584972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1214/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:50.786661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:50.787832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:50.788229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:50.811925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:50.813171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:50.836708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81929-ebdc-467a-bf1f-edac3e5024f6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:50.837142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81929-ebdc-467a-bf1f-edac3e5024f6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:50.837449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81929-ebdc-467a-bf1f-edac3e5024f6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:50.840711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1215/2427] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 10 17:08:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 17:08:50.847023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:50.847405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:50.847811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:50.876759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] MFA Rules not processed for user `fa5c3ba51f2c4d5583dbd3ebbafed5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:50.879405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:50.893861 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1213/2428] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:08:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:50.945181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:50.946883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:50.990614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1216/2429] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 10 17:08:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:08:50.991288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:50.992711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:51.009463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f24cc-ac28-4f3f-b0f1-bc9a4a57f260 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.017543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.018274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.018548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.018815 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] PATH_INFO: `/v3/users/8f75312554114e81a2720c44ffc3ec3a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.020021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f75312554114e81a2720c44ffc3ec3a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.021990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.033237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cd87-658a-4946-9bb7-6a44a13a674c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.039306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.039653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.039761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.040025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.048241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:51.049737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.051665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.061280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1214/2430] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:08:51.062241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.064049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:51.076036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f75312554114e81a2720c44ffc3ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.081917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3926b7d-43f0-4e59-844c-26b7d9041962 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.089461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.090799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.090933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.091202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.091471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f75312554114e81a2720c44ffc3ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.100893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f75312554114e81a2720c44ffc3ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.102503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f75312554114e81a2720c44ffc3ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.103148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ae82bce9-644a-4942-82c1-2cc96c6f4ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f75312554114e81a2720c44ffc3ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.104402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.106884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.118792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1215/2431] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:51.120743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1217/2432] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:08:50 2022] DELETE /identity/v3/users/8f75312554114e81a2720c44ffc3ec3a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:51.331058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.344213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15586-a295-4b2a-9033-9ce95f12fe8c service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.416702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.417338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.417617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.417888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] PATH_INFO: `/v3/projects/0a504773617744f493330e22bdc139e5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.419009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a504773617744f493330e22bdc139e5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.422297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.433435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:51.492796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a504773617744f493330e22bdc139e5', 'request_id': 'req-a7108816-47af-4452-9148-508dc4dad9bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.503843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a504773617744f493330e22bdc139e5', 'request_id': 'req-a7108816-47af-4452-9148-508dc4dad9bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.515519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a504773617744f493330e22bdc139e5', 'request_id': 'req-a7108816-47af-4452-9148-508dc4dad9bd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.535376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] The token cache is being invalidate because project 0a504773617744f493330e22bdc139e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:08:51.535669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.536336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7108816-47af-4452-9148-508dc4dad9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:51.537866 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1216/2433] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:08:51 2022] DELETE /identity/v3/projects/0a504773617744f493330e22bdc139e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:51.543273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.543776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.544115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.568508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:51.569701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:51.651423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1218/2434] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:51.660030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.660320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.660621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.683699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:51.689097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:51.704899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1217/2435] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:51.705255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.715242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973be431-3171-4219-9efb-ce7ee5495251 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.721041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.721655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.721931 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.722200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.722858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:08:51.723156 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.724794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.739668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1219/2436] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:08:51.744095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.769405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eb5d6-8bfa-48bb-827b-3a73c96a4135 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.777195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.777812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.778087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.778352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.778979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.781076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.815262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1218/2437] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:08:51 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:08:51.819634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.830330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428b1f6-da0d-4bd9-88f3-a02dfc25cecd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.892545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.893206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.893574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.893854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.894487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.896507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.921182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1220/2438] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:08:51 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:08:51.925425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.937461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70011e-3b1f-41b2-b0dd-9b27b620d1cf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.942397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.943014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.943292 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.943563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.944207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.945843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.957676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1219/2439] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:08:51.962454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:51.972956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7c89b-90ee-4e65-b2f6-88d880052d6b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:51.977628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:51.978252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:51.978529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:51.978798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:51.979442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:51.981067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf947ff-9c88-4950-a6db-6ab4bee14e53 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:51.992572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1221/2440] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:08:51.997209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:52.009340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be641bfa-232c-47cb-ac76-eb4410acb484 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:52.015217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:52.015574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:52.015857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:52.016134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] PATH_INFO: `/v3/projects/9432dd2657414fc28124a7249168fad0/users/f756d8c34898495399e0fe1fc2164842/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:52.032514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9432dd2657414fc28124a7249168fad0, user_id=f756d8c34898495399e0fe1fc2164842, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:52.035175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:52.051775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1220/2441] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:08:51 2022] PUT /identity/v3/projects/9432dd2657414fc28124a7249168fad0/users/f756d8c34898495399e0fe1fc2164842/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:52.063426 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:52.063719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:52.063984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:52.080271 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:52.096982 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] MFA Rules not processed for user `f756d8c34898495399e0fe1fc2164842`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:52.098641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:52.178502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1222/2442] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:52.190151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:52.191880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:52.278664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9bac4-5d3b-47cd-87e5-c62406fcc602 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:52.290459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:52.291091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:52.291376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:52.291644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:52.301401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:52.303305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9499598-4ddd-43f3-8e9c-c4ba7dd279cf service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:52.313890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1221/2443] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:55.213567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:55.287563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed61e5-ef0e-422e-b862-2e44bbcc0839 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:55.292060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:55.292739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:55.293019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:55.293286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] PATH_INFO: `/v3/users/f756d8c34898495399e0fe1fc2164842` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:55.294463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f756d8c34898495399e0fe1fc2164842)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:55.296949 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:55.353677 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f756d8c34898495399e0fe1fc2164842'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:55.367469 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f756d8c34898495399e0fe1fc2164842'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:55.375424 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f756d8c34898495399e0fe1fc2164842'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:55.376175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f756d8c34898495399e0fe1fc2164842'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:55.376822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f756d8c34898495399e0fe1fc2164842'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:55.394636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1223/2444] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:08:55 2022] DELETE /identity/v3/users/f756d8c34898495399e0fe1fc2164842 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:55.399142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:55.399600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:55.399886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:55.425908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:55.427589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:55.446064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:55.518777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1222/2445] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:08:55.527762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:55.531170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:55.555818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:55.605452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9078e7-7680-4e50-b8d5-60ecc7444950 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:55.611095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:55.611733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:55.612009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:55.612274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:55.622576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:55.624037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccada4b0-2e10-4b79-acd2-005c54398237 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:55.637122 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1224/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:55.929771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:55.931353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:55.955029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db59ccf-95e9-40ca-86e9-a9381e5cfdf6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:55.958715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:55.959495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:55.959854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:55.960201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] PATH_INFO: `/v3/projects/9432dd2657414fc28124a7249168fad0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:55.961553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9432dd2657414fc28124a7249168fad0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:55.963621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.024241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9432dd2657414fc28124a7249168fad0', 'request_id': 'req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:56.033309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9432dd2657414fc28124a7249168fad0', 'request_id': 'req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:56.041476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9432dd2657414fc28124a7249168fad0', 'request_id': 'req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:56.055635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] The token cache is being invalidate because project 9432dd2657414fc28124a7249168fad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:08:56.056150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:56.057091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-996fe4a0-2abe-4ed2-88ab-9e7f5aa005df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:56.058818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1223/2447] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:08:55 2022] DELETE /identity/v3/projects/9432dd2657414fc28124a7249168fad0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:56.064571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.065010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.066050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.091633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:56.093078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:56.175224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1225/2448] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:56.183664 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.184133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.184628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.223730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:56.225655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:56.244534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1224/2449] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:56.252027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.263021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d384-ede7-42ce-a227-1dd79eb9e73e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.269375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.270700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.271040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.271511 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.272312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:08:56.272898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.274771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.294229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1226/2450] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:08:56.299330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.309823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356b993-a235-4c09-b7f1-1d80ae26d049 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.323971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.324699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.324989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.325266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.326019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.328322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.368026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1225/2451] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:08:56.372103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.384325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79da60-e1ed-4f2e-b16c-9452d021b734 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.484171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.484901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.485246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.485579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.486389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.488373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.510602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1227/2452] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/users => generated 302 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:08:56.515336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.525558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4923f-0626-4f54-931e-89b0c70cc5aa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.531015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.531634 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.531923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.532188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.532880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.534516 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.548879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1226/2453] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:08:56.554315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.564784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fecac-d386-44d7-a32c-f1bc9659154e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.569628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.570220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.570496 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.570764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.571401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.573019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148fa83-6908-4e57-a64d-93dc82d0aca2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.584662 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1228/2454] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:08:56.589281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.600457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c62ba1-8cac-45cb-9b21-b5befc2dbc15 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.605780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.606447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.606725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.606997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] PATH_INFO: `/v3/projects/e75b0d2e160f456793a34ee35b8b21d0/users/7389163414f640ebbcd7ec38cc2a7400/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.625771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75b0d2e160f456793a34ee35b8b21d0, user_id=7389163414f640ebbcd7ec38cc2a7400, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.628510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.645501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1227/2455] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:08:56 2022] PUT /identity/v3/projects/e75b0d2e160f456793a34ee35b8b21d0/users/7389163414f640ebbcd7ec38cc2a7400/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:56.657227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.657506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.657954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.690824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] MFA Rules not processed for user `7389163414f640ebbcd7ec38cc2a7400`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:56.692235 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:56.707729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:56.796778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1229/2456] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:56.799712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.870069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:56.900640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a322-7ef4-4980-b0a8-b5b4e3ad4680 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:56.906830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:56.908775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:56.909783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:56.909783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:56.912506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:56.913762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:56.946065 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1228/2457] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:08:56.952185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:56.972933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c8cef-4af4-4436-a42a-36b9a1971502 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.042866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.043927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.043927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.044368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.046042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.048116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.075189 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1230/2458] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:08:56 2022] POST /identity/v3/users => generated 308 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:08:57.079077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.089633 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e6e1-1347-4cff-b628-e889eb284817 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.096051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.096836 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.097178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.097527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.098309 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.100031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.111978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1229/2459] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:08:57.116222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.131299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66513b-9e8a-4bf0-a6f8-31e212dd1b33 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.136726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.137537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.137830 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.138105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] PATH_INFO: `/v3/projects/0d35b98c0f094919b9cf2020a13d67cb/users/35eeb0f43d2548be9bbaacfbba9fc8f1/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.153887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d35b98c0f094919b9cf2020a13d67cb, user_id=35eeb0f43d2548be9bbaacfbba9fc8f1, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.157087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.172076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1231/2460] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:08:57 2022] PUT /identity/v3/projects/0d35b98c0f094919b9cf2020a13d67cb/users/35eeb0f43d2548be9bbaacfbba9fc8f1/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:57.176009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.186082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193da6e-51bc-430c-b34a-32554fb2b9f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.244940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.245558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.245853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.246113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.246761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.248511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763d502-d4a1-42f0-899a-a6b0e0db8938 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.259086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1230/2461] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:08:57.263647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.274824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87142b97-a9b7-4060-a03d-aa7280878a85 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.280209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.280855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.281135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.281438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] PATH_INFO: `/v3/projects/0d35b98c0f094919b9cf2020a13d67cb/users/35eeb0f43d2548be9bbaacfbba9fc8f1/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.283375 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d35b98c0f094919b9cf2020a13d67cb, user_id=35eeb0f43d2548be9bbaacfbba9fc8f1, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.286144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.298722 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1232/2462] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:08:57 2022] PUT /identity/v3/projects/0d35b98c0f094919b9cf2020a13d67cb/users/35eeb0f43d2548be9bbaacfbba9fc8f1/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:57.311676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.311966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.312438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.349797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] MFA Rules not processed for user `35eeb0f43d2548be9bbaacfbba9fc8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:57.352262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:57.475659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1231/2463] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:57.488377 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.490774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:57.569789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000475dd-8d4b-48d5-a5ba-ea25d898ade5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.576820 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.577849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.578346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.578819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.594762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.596388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bb53c-c9ee-42a0-a238-cf7e0a3af090 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:57.610256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1233/2464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:57 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:57.797216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:57.853430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:57.905256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727d05-7fc4-4de0-9bac-cb3dda007955 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:57.923239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:57.924906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:57.925434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:57.926576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] PATH_INFO: `/v3/users/7389163414f640ebbcd7ec38cc2a7400` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:57.928731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7389163414f640ebbcd7ec38cc2a7400)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:57.931305 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:58.030280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7389163414f640ebbcd7ec38cc2a7400'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.040393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7389163414f640ebbcd7ec38cc2a7400'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.041277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7389163414f640ebbcd7ec38cc2a7400'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.042130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7389163414f640ebbcd7ec38cc2a7400'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.052195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7389163414f640ebbcd7ec38cc2a7400'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.083526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1232/2465] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:08:57 2022] DELETE /identity/v3/users/7389163414f640ebbcd7ec38cc2a7400 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:58.087955 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:58.088261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:58.088537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:58.120178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:58.121613 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:58.126280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:58.199697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1234/2466] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:08:58.211641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:58.218714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:58.294512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f64d-9554-45c5-bb92-0509a94220a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:58.298832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:58.299450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:58.299729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:58.300004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:58.316999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:58.316999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:58.333275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1233/2467] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:08:58.665033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:58.666596 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:58.679367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b034f0-89a0-4d13-893e-56ee8224d204 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:58.690486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:58.691450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:58.691887 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:58.692374 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] PATH_INFO: `/v3/projects/e75b0d2e160f456793a34ee35b8b21d0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:58.694630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75b0d2e160f456793a34ee35b8b21d0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:58.696864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:58.761086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75b0d2e160f456793a34ee35b8b21d0', 'request_id': 'req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.772227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75b0d2e160f456793a34ee35b8b21d0', 'request_id': 'req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.787741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75b0d2e160f456793a34ee35b8b21d0', 'request_id': 'req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.824575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] The token cache is being invalidate because project e75b0d2e160f456793a34ee35b8b21d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:08:58.825104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.826174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:58.829010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1235/2468] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:08:58 2022] DELETE /identity/v3/projects/e75b0d2e160f456793a34ee35b8b21d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:58.833578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:58.848907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9ca89-4e1e-436d-bae1-eca4ac8d5e76 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:58.927003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:58.939630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:58.941320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:58.941690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:58.942045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] PATH_INFO: `/v3/users/35eeb0f43d2548be9bbaacfbba9fc8f1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:58.943381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35eeb0f43d2548be9bbaacfbba9fc8f1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:58.945811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:59.025320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35eeb0f43d2548be9bbaacfbba9fc8f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.037789 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35eeb0f43d2548be9bbaacfbba9fc8f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.038667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35eeb0f43d2548be9bbaacfbba9fc8f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.039449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35eeb0f43d2548be9bbaacfbba9fc8f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.053458 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35eeb0f43d2548be9bbaacfbba9fc8f1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.090550 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1234/2469] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:08:58 2022] DELETE /identity/v3/users/35eeb0f43d2548be9bbaacfbba9fc8f1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:59.472051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:59.475607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:59.509504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34b14b-89ca-466e-974b-9d2a5cc31a8d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:59.550221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:59.551676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:59.596291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:59.597054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.597389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.597697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] PATH_INFO: `/v3/projects/0d35b98c0f094919b9cf2020a13d67cb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.598840 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d35b98c0f094919b9cf2020a13d67cb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:59.600777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:59.635286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e539a1-4319-4e48-9ee3-ecd6ed5546d3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:59.643913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:59.645657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:59.646587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.646910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.647193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] PATH_INFO: `/v3/users/463bcb98107f409db2fe6248107d6d0d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.648473 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=463bcb98107f409db2fe6248107d6d0d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:59.650674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:59.661043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d35b98c0f094919b9cf2020a13d67cb', 'request_id': 'req-9b6d84c5-128f-4135-a067-2835d690d6dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.666527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d35b98c0f094919b9cf2020a13d67cb', 'request_id': 'req-9b6d84c5-128f-4135-a067-2835d690d6dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.673037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d35b98c0f094919b9cf2020a13d67cb', 'request_id': 'req-9b6d84c5-128f-4135-a067-2835d690d6dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.688416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] The token cache is being invalidate because project 0d35b98c0f094919b9cf2020a13d67cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:08:59.688748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.689399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b6d84c5-128f-4135-a067-2835d690d6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.691011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1236/2470] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:08:59 2022] DELETE /identity/v3/projects/0d35b98c0f094919b9cf2020a13d67cb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:08:59.695900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.696264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.697058 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.707565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463bcb98107f409db2fe6248107d6d0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.718544 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463bcb98107f409db2fe6248107d6d0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.719440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463bcb98107f409db2fe6248107d6d0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.720334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463bcb98107f409db2fe6248107d6d0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.732779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:59.734392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:59.739072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0bb3ac8e-7cdc-4167-84e5-9f16891706fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463bcb98107f409db2fe6248107d6d0d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:08:59.753028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:08:59.762481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1235/2471] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:08:59 2022] DELETE /identity/v3/users/463bcb98107f409db2fe6248107d6d0d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:08:59.815877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1237/2472] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:08:59.823814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.824269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.824376 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.846213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:08:59.847478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:59.909250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1236/2473] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:08:59.913538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:59.928050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5840e4a-0dc2-424c-b65a-ae220899da1b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:59.933726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:59.934376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.934658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.934986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.936679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:08:59.937064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:59.938687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:59.949618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:59.951110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:08:59.955459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1238/2474] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:08:59.957533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:08:59.963655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428333-4b11-4d97-af46-74d31afd0204 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:59.968880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:59.969545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.969820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.970088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] PATH_INFO: `/v3/projects/b8ab524ebcc444ca8bd3e4a261b1ea57` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.971233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ab524ebcc444ca8bd3e4a261b1ea57)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:59.973177 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:08:59.980634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a447bb-7aeb-41c2-bc50-931e309b186e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:08:59.986306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:08:59.986914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:08:59.987198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:08:59.987474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:08:59.988101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:08:59.990068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.020516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1239/2475] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:08:59 2022] POST /identity/v3/projects => generated 405 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:00.022902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.026745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ab524ebcc444ca8bd3e4a261b1ea57', 'request_id': 'req-9b914a9d-3392-4545-ada8-a957298aadbc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.039865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ab524ebcc444ca8bd3e4a261b1ea57', 'request_id': 'req-9b914a9d-3392-4545-ada8-a957298aadbc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.049487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ab524ebcc444ca8bd3e4a261b1ea57', 'request_id': 'req-9b914a9d-3392-4545-ada8-a957298aadbc'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.062003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] The token cache is being invalidate because project b8ab524ebcc444ca8bd3e4a261b1ea57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:00.062319 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.063074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.065088 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1237/2476] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:08:59 2022] DELETE /identity/v3/projects/b8ab524ebcc444ca8bd3e4a261b1ea57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:00.068905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.070270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:00.094416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3be088-f2f8-49b0-9cbd-d0efb7832d7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.101420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.102032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.102316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.102588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.103224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.105541 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.133401 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1240/2477] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:00 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:00.137089 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.139039 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:00.150918 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767006c-b8cc-4d87-9e63-d7f85fc2a8dd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.156813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.157046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b914a9d-3392-4545-ada8-a957298aadbc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.157675 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.157948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.158219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.158860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.160432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.162543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.163241 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.163459 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.163734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] PATH_INFO: `/v3/users/e97025dbce7b425aa717eacc2bf57671` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.165167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97025dbce7b425aa717eacc2bf57671)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.167312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.172868 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1241/2478] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:00.177454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.190238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310da7be-4b21-4e33-832e-ffcc9844874e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.195891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.196521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.196875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.197165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.197912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.199347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.200920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:00.201588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:00.216328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1242/2479] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:09:00.223479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.244790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09781-f30e-478d-8cee-b174742588e6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.252852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97025dbce7b425aa717eacc2bf57671'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.254047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.254750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.255018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.255293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] PATH_INFO: `/v3/projects/6ca140723bcd4c09a54ce84286c9f086/users/123ddb286c414f71baec5ff2535a312d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.262437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97025dbce7b425aa717eacc2bf57671'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.263198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97025dbce7b425aa717eacc2bf57671'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.264869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97025dbce7b425aa717eacc2bf57671'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.274325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca140723bcd4c09a54ce84286c9f086, user_id=123ddb286c414f71baec5ff2535a312d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.277429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70011c5d-152a-4915-b621-bda812754c8d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.279071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97025dbce7b425aa717eacc2bf57671'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.301725 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1243/2480] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:00 2022] PUT /identity/v3/projects/6ca140723bcd4c09a54ce84286c9f086/users/123ddb286c414f71baec5ff2535a312d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:00.307328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.307609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.307875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.311522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1238/2481] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:00 2022] DELETE /identity/v3/users/e97025dbce7b425aa717eacc2bf57671 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:00.328443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:00.329966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:00.406099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1244/2482] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:00.413793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.415512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:00.495205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e207c-a11f-4667-a05c-ef2de69d7a88 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.501508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.502191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.502462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.502757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.515076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:00.517176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:00.517864 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.520100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fffb6-f40e-4377-8f1d-291a43af6bf4 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.540724 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1239/2483] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:00.549837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234950-d87e-4c8d-8ed7-862666441e61 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:00.554556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:00.555213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:00.555472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:00.555740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] PATH_INFO: `/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:00.557113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf7ff7aeffe46658b2d041c61633e3e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:00.559384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:00.648123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf7ff7aeffe46658b2d041c61633e3e', 'request_id': 'req-95f271be-6287-4653-b899-08e4ca04ce54'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.656718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf7ff7aeffe46658b2d041c61633e3e', 'request_id': 'req-95f271be-6287-4653-b899-08e4ca04ce54'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.668276 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf7ff7aeffe46658b2d041c61633e3e', 'request_id': 'req-95f271be-6287-4653-b899-08e4ca04ce54'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.692009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] The token cache is being invalidate because project 3cf7ff7aeffe46658b2d041c61633e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:00.692963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.693534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:00.697010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1245/2484] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:00 2022] DELETE /identity/v3/projects/3cf7ff7aeffe46658b2d041c61633e3e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:01.324396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.324888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.324985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.355771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] MFA Rules not processed for user `123ddb286c414f71baec5ff2535a312d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:01.357035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:01.427573 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1240/2485] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:01.432150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.433572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:01.501753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:01.507230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f271be-6287-4653-b899-08e4ca04ce54 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.513576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.514278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.514564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.515047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.515684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.517620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.550338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1246/2486] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:01 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:01.554403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.567580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcfd7c-379d-4c75-a9ed-ae9ef1b83f7f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.600677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:01.632517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.633146 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.633429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.633702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.634338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.636284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.658980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1241/2487] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:01 2022] POST /identity/v3/users => generated 308 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:01.663201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.674212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b38c6-7300-431d-86c6-624dc7e22dc4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.679413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.680012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.680287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.680637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.681280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.682857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.693770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1247/2488] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:01.698010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.708869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887b9e-d17f-46cd-afbe-e96dbca3a921 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.713958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.714610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.714948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.715259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] PATH_INFO: `/v3/projects/64e52055d1904deba64074d470297f70/users/a19830e67329451898474332de36a283/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.731285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e52055d1904deba64074d470297f70, user_id=a19830e67329451898474332de36a283, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.735142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.755129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1242/2489] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:01 2022] PUT /identity/v3/projects/64e52055d1904deba64074d470297f70/users/a19830e67329451898474332de36a283/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:01.760277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.770983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198cb7a-37ab-40d9-ab51-e364d2c3812f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.839295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.839718 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.839995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.840264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.840943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.843854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be584-04ec-4f8a-bc41-070f4cecb8ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.859272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1248/2490] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:09:01.863814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:01.875304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d967-5176-4bdf-a684-4e5a51e968ff admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:01.880439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:01.881195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:01.881599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:01.881969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] PATH_INFO: `/v3/projects/64e52055d1904deba64074d470297f70/users/a19830e67329451898474332de36a283/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:01.884081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e52055d1904deba64074d470297f70, user_id=a19830e67329451898474332de36a283, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:01.886801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:01.898697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1243/2491] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:01 2022] PUT /identity/v3/projects/64e52055d1904deba64074d470297f70/users/a19830e67329451898474332de36a283/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:02.654556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:02.654884 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:02.655140 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:02.688332 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] MFA Rules not processed for user `a19830e67329451898474332de36a283`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:02.689614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:02.769578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1249/2492] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:04.161453 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:04.233502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ee75-ac4a-465f-a87f-7c3b47629415 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:04.239511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:04.239511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:04.239511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:04.239511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] PATH_INFO: `/v3/users/123ddb286c414f71baec5ff2535a312d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:04.241666 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=123ddb286c414f71baec5ff2535a312d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:04.243336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:04.302840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123ddb286c414f71baec5ff2535a312d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.312283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123ddb286c414f71baec5ff2535a312d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.313116 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123ddb286c414f71baec5ff2535a312d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.313743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123ddb286c414f71baec5ff2535a312d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.322435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123ddb286c414f71baec5ff2535a312d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.346561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1244/2493] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:04 2022] DELETE /identity/v3/users/123ddb286c414f71baec5ff2535a312d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:04.529882 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:04.544070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b459-352c-4180-a4ad-a096950b1419 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:04.610854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:04.624605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:04.625360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:04.625726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:04.626340 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] PATH_INFO: `/v3/projects/6ca140723bcd4c09a54ce84286c9f086` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:04.628158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca140723bcd4c09a54ce84286c9f086)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:04.630188 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:04.695727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca140723bcd4c09a54ce84286c9f086', 'request_id': 'req-f09980e6-ad27-472e-a653-c5f2cc981285'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.705961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca140723bcd4c09a54ce84286c9f086', 'request_id': 'req-f09980e6-ad27-472e-a653-c5f2cc981285'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.713359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca140723bcd4c09a54ce84286c9f086', 'request_id': 'req-f09980e6-ad27-472e-a653-c5f2cc981285'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.728933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] The token cache is being invalidate because project 6ca140723bcd4c09a54ce84286c9f086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:04.729295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.729994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.731737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1250/2494] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:04 2022] DELETE /identity/v3/projects/6ca140723bcd4c09a54ce84286c9f086 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:04.737098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:04.738931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:04.750074 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:04.756033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd879-ed90-4f69-a025-2b5ffa0209bf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:04.833986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:04.834612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:04.834896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:04.835167 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] PATH_INFO: `/v3/users/a19830e67329451898474332de36a283` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:04.836941 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19830e67329451898474332de36a283)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:04.839017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:04.914049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19830e67329451898474332de36a283'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.922734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19830e67329451898474332de36a283'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.923415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19830e67329451898474332de36a283'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.924170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19830e67329451898474332de36a283'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.931909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-41aa44b2-998b-4c27-b5e5-b6fa1ba74ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19830e67329451898474332de36a283'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:04.951888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1245/2495] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:04 2022] DELETE /identity/v3/users/a19830e67329451898474332de36a283 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:05.128310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.129872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:05.146855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09980e6-ad27-472e-a653-c5f2cc981285 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.207291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.207919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.208199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.208473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] PATH_INFO: `/v3/projects/64e52055d1904deba64074d470297f70` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.209676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e52055d1904deba64074d470297f70)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.211614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.261512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e52055d1904deba64074d470297f70', 'request_id': 'req-306aa384-8025-42f1-a509-fe8a08dce6ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:05.267581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e52055d1904deba64074d470297f70', 'request_id': 'req-306aa384-8025-42f1-a509-fe8a08dce6ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:05.273679 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e52055d1904deba64074d470297f70', 'request_id': 'req-306aa384-8025-42f1-a509-fe8a08dce6ac'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:05.286975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] The token cache is being invalidate because project 64e52055d1904deba64074d470297f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:05.287261 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:05.287914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-306aa384-8025-42f1-a509-fe8a08dce6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:05.289438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1251/2496] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:05 2022] DELETE /identity/v3/projects/64e52055d1904deba64074d470297f70 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:05.294335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.295507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.295507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.315844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:05.317160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:05.385360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1246/2497] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:05.393286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.393568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.393846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.415713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:05.416968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:05.425562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1252/2498] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:05.429848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.440022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f0c0b-d747-403e-ba0f-01beb01e5bb8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.444679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.445284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.445564 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.445840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.446502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:05.446827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.448444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.461260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1247/2499] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:05.465895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.472913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:05.477512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5da3b-2044-4ac4-a170-079bfb4e7eb1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.486708 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.487943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.488419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.489132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.490437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.493707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.522990 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1253/2500] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:05.528186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.539120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a0c4-ea0e-48f1-a5a7-b4b600b40578 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.543949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:05.598876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.599489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.599772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.600049 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.600719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.602705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.624801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1248/2501] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:05.629044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.639402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e09e5-6b4c-43ab-92b9-3d9c11907211 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.644044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.644676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.644958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.645230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.645878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.647461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.659585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1254/2502] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:05.663618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.675068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada944a-7a67-453f-bfe1-be8e076ce48e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.679612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.680206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.680512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.680780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.681415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.683005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608727f-4ae8-4706-9ad2-aee22c67b3d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.696408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1249/2503] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:05.701282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.712086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57803-8fd9-4df0-a410-75d10efbe025 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.717732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.718480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.718757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.719030 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] PATH_INFO: `/v3/projects/13c3a41f62a24a4f9cead6b2eec512eb/users/9bb227b0c0804a30ba7a96e88c7121b6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.734180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c3a41f62a24a4f9cead6b2eec512eb, user_id=9bb227b0c0804a30ba7a96e88c7121b6, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.736842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:05.750466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1255/2504] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:05 2022] PUT /identity/v3/projects/13c3a41f62a24a4f9cead6b2eec512eb/users/9bb227b0c0804a30ba7a96e88c7121b6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:05.760949 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.761314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.761591 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.790563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] MFA Rules not processed for user `9bb227b0c0804a30ba7a96e88c7121b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:05.791778 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:05.864032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1250/2505] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:05.868860 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:05.951996 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7427e0f-4c06-4778-91b4-b8e5607a89d5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:05.957960 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:05.958715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:05.959001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:05.959280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:05.959984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:05.962711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.008434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1256/2506] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:05 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:06.012667 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.024220 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6aa0f-3b38-45eb-b679-4d7ffddea645 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.102278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.102900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.103182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.103457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.104082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.106060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.128839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1251/2507] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:06 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:06.133006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.143288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474ae1c-80d4-4537-920a-f20502870c7c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.148149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.148780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.149064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.149333 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.149985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.151581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.164805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1257/2508] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:06.170488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.181314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba230d-0e30-4d75-949d-a414d80cca64 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.186838 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.187497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.187777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.188058 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] PATH_INFO: `/v3/projects/db3e7db4a0f44029aa5293146bb09c8e/users/b86d41e3d327491498692a176afaf3e9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.190430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:06.210465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3e7db4a0f44029aa5293146bb09c8e, user_id=b86d41e3d327491498692a176afaf3e9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.213278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.227517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1252/2509] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:06 2022] PUT /identity/v3/projects/db3e7db4a0f44029aa5293146bb09c8e/users/b86d41e3d327491498692a176afaf3e9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:06.231277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.243138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c93cca-d74a-4c1e-88e0-640e2bf61b67 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.306415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.307113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.307460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.307742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.308385 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.310036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d813b1-ab45-4f31-92a0-295572627cc4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.321615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1258/2510] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:06.325843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.337032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd759a-58bd-4070-b5a4-1025cc387f22 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.342339 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.342994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.343419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.343704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] PATH_INFO: `/v3/projects/db3e7db4a0f44029aa5293146bb09c8e/users/b86d41e3d327491498692a176afaf3e9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.345708 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3e7db4a0f44029aa5293146bb09c8e, user_id=b86d41e3d327491498692a176afaf3e9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.348352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.360402 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1253/2511] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:06 2022] PUT /identity/v3/projects/db3e7db4a0f44029aa5293146bb09c8e/users/b86d41e3d327491498692a176afaf3e9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:06.372014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.372304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.372604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.403054 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] MFA Rules not processed for user `b86d41e3d327491498692a176afaf3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:06.405264 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:06.411196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:06.477812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1259/2512] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:06.488992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:06.490705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:06.549060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7111d0-14c7-4f98-85ed-ffab4fc3a40e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:06.552889 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:06.553511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:06.553783 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:06.554056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:06.563796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:06.565311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f452c-8d20-4962-848a-db0637143ef8 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:06.574878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1254/2513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:06.984019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:07.051697 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a7831-054d-4306-994c-7e5f3e3adebe None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:07.056230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:07.056886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:07.057161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:07.057429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] PATH_INFO: `/v3/users/9bb227b0c0804a30ba7a96e88c7121b6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:07.058614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb227b0c0804a30ba7a96e88c7121b6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:07.060528 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:07.106177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb227b0c0804a30ba7a96e88c7121b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.121365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb227b0c0804a30ba7a96e88c7121b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.128940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb227b0c0804a30ba7a96e88c7121b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.129665 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb227b0c0804a30ba7a96e88c7121b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.130282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb227b0c0804a30ba7a96e88c7121b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.145700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1260/2514] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:06 2022] DELETE /identity/v3/users/9bb227b0c0804a30ba7a96e88c7121b6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:07.150173 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:07.150669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:07.150923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:07.171599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:07.172887 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:07.235630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1255/2515] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:09:07.251010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:07.252583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:07.280897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:07.316535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b6c10-7217-43eb-9d4b-3287f0667e3a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:07.320170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:07.320809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:07.321091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:07.321360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:07.331370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:07.332913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:07.342775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1261/2516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:07.650006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:07.652409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:07.666338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6accbfac-4072-43aa-9319-538ca9d4bd2f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:07.672529 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:07.673217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:07.673507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:07.673793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] PATH_INFO: `/v3/projects/13c3a41f62a24a4f9cead6b2eec512eb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:07.674948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c3a41f62a24a4f9cead6b2eec512eb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:07.676905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:07.728900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c3a41f62a24a4f9cead6b2eec512eb', 'request_id': 'req-99fbe6a9-d630-4c79-89c6-982c1372e64a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.734719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c3a41f62a24a4f9cead6b2eec512eb', 'request_id': 'req-99fbe6a9-d630-4c79-89c6-982c1372e64a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.742875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c3a41f62a24a4f9cead6b2eec512eb', 'request_id': 'req-99fbe6a9-d630-4c79-89c6-982c1372e64a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.745238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:07.756855 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] The token cache is being invalidate because project 13c3a41f62a24a4f9cead6b2eec512eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:07.757142 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.757797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.759478 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1256/2517] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:07 2022] DELETE /identity/v3/projects/13c3a41f62a24a4f9cead6b2eec512eb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:07.763226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:07.773753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62354b45-c7b6-4949-87d7-34c65e4cffb6 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:07.838101 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:07.838749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:07.839036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:07.839316 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] PATH_INFO: `/v3/users/b86d41e3d327491498692a176afaf3e9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:07.840623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86d41e3d327491498692a176afaf3e9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:07.843291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:07.892577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86d41e3d327491498692a176afaf3e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.905843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86d41e3d327491498692a176afaf3e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.913536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86d41e3d327491498692a176afaf3e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.914315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86d41e3d327491498692a176afaf3e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.914943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-59e13f8a-a0de-48d2-9606-2b98768c5a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86d41e3d327491498692a176afaf3e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:07.931490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1262/2518] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:07 2022] DELETE /identity/v3/users/b86d41e3d327491498692a176afaf3e9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:08.212244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.213852 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:08.230019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe6a9-d630-4c79-89c6-982c1372e64a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.288897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.289441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.289718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.289987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] PATH_INFO: `/v3/projects/db3e7db4a0f44029aa5293146bb09c8e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.291090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3e7db4a0f44029aa5293146bb09c8e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.293170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.344761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3e7db4a0f44029aa5293146bb09c8e', 'request_id': 'req-5546d0c9-1314-4093-a282-ad37f5992a75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:08.350379 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3e7db4a0f44029aa5293146bb09c8e', 'request_id': 'req-5546d0c9-1314-4093-a282-ad37f5992a75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:08.360087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3e7db4a0f44029aa5293146bb09c8e', 'request_id': 'req-5546d0c9-1314-4093-a282-ad37f5992a75'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:08.371816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] The token cache is being invalidate because project db3e7db4a0f44029aa5293146bb09c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:08.372105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:08.372837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5546d0c9-1314-4093-a282-ad37f5992a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:08.374720 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1257/2519] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:08 2022] DELETE /identity/v3/projects/db3e7db4a0f44029aa5293146bb09c8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:08.379741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.380215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.380336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.399649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:08.400892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:08.444129 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:08.465976 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1263/2520] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:08.476014 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.476312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.476616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.497086 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:08.498962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:08.509454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1258/2521] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:08.513712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.524015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945cad1-97c5-407e-a9b1-7f73cf90cf15 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.528692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.529291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.529599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.529869 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.530519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:08.530821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.532403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.544269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1264/2522] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:08.550106 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.559224 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c32ae5-b7c3-4edf-983e-9ec86a184c16 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.565370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.565962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.566240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.566508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.567123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.569033 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.596804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1259/2523] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:08.600902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.610870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b227da-20e7-48f4-a1d2-b13b8ef1cf47 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.675110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.675714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.675991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.676257 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.676923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.678818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.703175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1265/2524] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:08.707557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.718009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa36f07-2bab-4675-b8d8-e5227299dc65 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.722687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.723286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.723566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.723837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.724504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.726192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.736659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1260/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:08.740875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.751936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8984c4-a619-47bc-8599-11daa0536355 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.756644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.757242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.757524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.757797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.758441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.760077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6799a-b4f5-43c8-abec-635a2751e945 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.771012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1266/2526] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:08.775121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.785886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab79be-b919-4467-b166-beb7a493acaf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:08.790624 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:08.791268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.791551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.791824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] PATH_INFO: `/v3/projects/291dcbbe4ab14b77882aed22476cfab2/users/8cebd573fa12461ab929e2c8c89810ed/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.807352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291dcbbe4ab14b77882aed22476cfab2, user_id=8cebd573fa12461ab929e2c8c89810ed, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:08.809958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:08.824704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1261/2527] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:08 2022] PUT /identity/v3/projects/291dcbbe4ab14b77882aed22476cfab2/users/8cebd573fa12461ab929e2c8c89810ed/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:08.837447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:08.837733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:08.838006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:08.866005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] MFA Rules not processed for user `8cebd573fa12461ab929e2c8c89810ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:08.867249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:08.931609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1267/2528] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:08.936334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:08.962275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:09.002120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f916c4-3677-42a9-8eb6-6e03218f9cb3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.006955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.007683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.008063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.008409 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.009207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.011492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.044734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1262/2529] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:08 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:09.046536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.057828 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a47e-3341-4e12-af5b-629eff33fa09 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.098272 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:09.118785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.119339 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.119618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.119893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.120547 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.122482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.144551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1268/2530] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:09 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:09.148608 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.160635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d30ca8-558e-4c7a-9217-6103e786a593 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.165314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.165951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.166234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.166505 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.167140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.168779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.180659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1263/2531] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:09.184871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.195021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f6dbb-5c1a-45f3-ab07-88c92fea5440 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.199753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.200397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.200721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.200993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] PATH_INFO: `/v3/projects/d819b0b1e1ed46f7860394d03585d382/users/ff29d37dc2d14c38b17ddc2b3837f367/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.216073 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d819b0b1e1ed46f7860394d03585d382, user_id=ff29d37dc2d14c38b17ddc2b3837f367, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.219494 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.234404 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1269/2532] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:09 2022] PUT /identity/v3/projects/d819b0b1e1ed46f7860394d03585d382/users/ff29d37dc2d14c38b17ddc2b3837f367/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:09.238447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.248821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3b9c0-dbc7-4b69-bfc8-518a9e20c8f9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.307017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.307628 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.307970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.308190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.308872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.310475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d087e-2336-45cd-b8d4-52eb85f81909 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.320475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1264/2533] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:09.324664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.335807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e53f4c-ca5b-41e3-90e7-fb0a5c35aac8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.340856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.341506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.341784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.342782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] PATH_INFO: `/v3/projects/d819b0b1e1ed46f7860394d03585d382/users/ff29d37dc2d14c38b17ddc2b3837f367/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.345028 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d819b0b1e1ed46f7860394d03585d382, user_id=ff29d37dc2d14c38b17ddc2b3837f367, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.347631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.359244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1270/2534] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:09 2022] PUT /identity/v3/projects/d819b0b1e1ed46f7860394d03585d382/users/ff29d37dc2d14c38b17ddc2b3837f367/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:09.369424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.369710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.369987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.397326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] MFA Rules not processed for user `ff29d37dc2d14c38b17ddc2b3837f367`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:09.398539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:09.477642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1265/2535] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:09.489785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:09.491578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:09.554268 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042866f-67f5-4386-9463-b868fb7c9be2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:09.558256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:09.558762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:09.559036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:09.559330 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:09.574827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:09.577844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b871-f25c-4bb8-9ffe-9846b7e3b261 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:09.589454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1271/2536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:10.026562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:10.047508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:10.090577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9b70b-a93b-4a09-b0da-b9e928ee6087 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:10.095663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:10.096294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:10.096611 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:10.096901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] PATH_INFO: `/v3/users/8cebd573fa12461ab929e2c8c89810ed` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:10.097996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cebd573fa12461ab929e2c8c89810ed)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:10.099923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:10.149105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cebd573fa12461ab929e2c8c89810ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:10.157921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cebd573fa12461ab929e2c8c89810ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:10.158574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cebd573fa12461ab929e2c8c89810ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:10.159188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cebd573fa12461ab929e2c8c89810ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:10.166427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cebd573fa12461ab929e2c8c89810ed'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:10.185989 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1266/2537] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:10 2022] DELETE /identity/v3/users/8cebd573fa12461ab929e2c8c89810ed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:10.191323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:10.191617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:10.191897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:10.213523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:10.215824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:10.420664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1272/2538] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:09:10.430295 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:10.431937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:10.503685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598a426-04d9-4b3c-ace1-de4dfbadab29 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:10.509195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:10.509195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:10.509195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:10.509195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:10.518881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:10.520487 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:10.530960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1267/2539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:11.100762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:11.102312 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:11.115673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f4bf-5df0-4b3e-976f-74aff56d40c9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:11.120668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:11.121512 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:11.121792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:11.122049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] PATH_INFO: `/v3/projects/291dcbbe4ab14b77882aed22476cfab2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:11.123319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291dcbbe4ab14b77882aed22476cfab2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:11.126132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:11.176739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:11.198011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291dcbbe4ab14b77882aed22476cfab2', 'request_id': 'req-da396be4-ed87-420c-b4a4-e6dd5748d5e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.206545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291dcbbe4ab14b77882aed22476cfab2', 'request_id': 'req-da396be4-ed87-420c-b4a4-e6dd5748d5e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.222097 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291dcbbe4ab14b77882aed22476cfab2', 'request_id': 'req-da396be4-ed87-420c-b4a4-e6dd5748d5e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.238934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] The token cache is being invalidate because project 291dcbbe4ab14b77882aed22476cfab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:11.239260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.240009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.244415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1273/2540] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:11 2022] DELETE /identity/v3/projects/291dcbbe4ab14b77882aed22476cfab2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:11.245732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:11.258552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa40630-aff5-4140-aecc-f577d30a5fc6 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:11.348858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:11.367663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:11.368288 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:11.368593 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:11.368865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] PATH_INFO: `/v3/users/ff29d37dc2d14c38b17ddc2b3837f367` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:11.369974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff29d37dc2d14c38b17ddc2b3837f367)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:11.372102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:11.439785 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff29d37dc2d14c38b17ddc2b3837f367'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.450110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff29d37dc2d14c38b17ddc2b3837f367'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.453540 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff29d37dc2d14c38b17ddc2b3837f367'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.454972 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff29d37dc2d14c38b17ddc2b3837f367'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.463970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2d006ee1-6553-4026-a160-0d35973590d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff29d37dc2d14c38b17ddc2b3837f367'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.502394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1268/2541] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:11 2022] DELETE /identity/v3/users/ff29d37dc2d14c38b17ddc2b3837f367 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:11.826327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:11.828967 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:11.849800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da396be4-ed87-420c-b4a4-e6dd5748d5e2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:11.925017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:11.926256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:11.926256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:11.926256 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] PATH_INFO: `/v3/projects/d819b0b1e1ed46f7860394d03585d382` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:11.927475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d819b0b1e1ed46f7860394d03585d382)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:11.929604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:11.989895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd819b0b1e1ed46f7860394d03585d382', 'request_id': 'req-5d368d40-2a72-40b0-a8e8-5a487e30dc29'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:11.997048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd819b0b1e1ed46f7860394d03585d382', 'request_id': 'req-5d368d40-2a72-40b0-a8e8-5a487e30dc29'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:12.007396 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd819b0b1e1ed46f7860394d03585d382', 'request_id': 'req-5d368d40-2a72-40b0-a8e8-5a487e30dc29'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:12.022505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] The token cache is being invalidate because project d819b0b1e1ed46f7860394d03585d382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:12.022803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:12.023434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5d368d40-2a72-40b0-a8e8-5a487e30dc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:12.024997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1274/2542] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:11 2022] DELETE /identity/v3/projects/d819b0b1e1ed46f7860394d03585d382 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:12.030492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.030779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.031048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.051782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:12.053029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:12.143359 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1269/2543] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:12.151116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.151653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.151653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.174319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:12.176062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:12.185384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1275/2544] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:12.190302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.202213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f7a49-ad19-4502-8127-f25b46e3e64d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.210091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.211087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.211737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.212052 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.213268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:12.213647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.216295 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.235735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1270/2545] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:12.239218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.249513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861e004-d16d-4196-9bea-a17ca79a1046 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.264759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.264759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.265128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.265229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.265813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.268009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.301911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1276/2546] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:12.306255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.317874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648773a-da58-4fcd-9ab3-bd70a2e88c12 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.371673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:12.387737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.388610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.389149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.389541 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.390265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.392984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.416973 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1271/2547] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:12.421803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.434427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ebda-75d7-4bf4-bf30-3318b93813a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.447971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.448606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.449100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.449422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.450170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.453159 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.465186 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1277/2548] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:09:12.469283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.482314 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f212-fd33-4a4c-8dd3-3a6580efc6ee admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.489343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.490282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.490794 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.491225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.492082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.494063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09168aa3-4fd9-4378-bec7-a7532bd850a6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.514693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1272/2549] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:12.519779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.531086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a4d2-d47f-4f8f-ae40-a639a7b8e6c4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.536221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.536926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.539147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.539147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] PATH_INFO: `/v3/projects/3fab935b0ba04f04ba2a5afa4814c9e9/users/f94f1dd060904cfba72278c3b3f3fef6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.543176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:12.566472 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fab935b0ba04f04ba2a5afa4814c9e9, user_id=f94f1dd060904cfba72278c3b3f3fef6, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.570542 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.593384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1278/2550] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:12 2022] PUT /identity/v3/projects/3fab935b0ba04f04ba2a5afa4814c9e9/users/f94f1dd060904cfba72278c3b3f3fef6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:12.666997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d81d8-e731-416f-b803-95502af82159 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.667585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d81d8-e731-416f-b803-95502af82159 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.668073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d81d8-e731-416f-b803-95502af82159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.708563 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1a4d81d8-e731-416f-b803-95502af82159 None None] MFA Rules not processed for user `f94f1dd060904cfba72278c3b3f3fef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:12.709884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1a4d81d8-e731-416f-b803-95502af82159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:12.809458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.809924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1273/2551] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:12.911957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ecf4-92df-4e0f-bc3d-e5d2e6b68b90 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:12.923061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:12.923680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.923961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.924242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.924920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:12.927351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:12.958034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:12.958578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:12.959007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:12.964831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1279/2552] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:12.970155 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:12.983493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:12.985629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:13.059960 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1274/2553] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:09:13.063644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1292b80-3f06-43c0-ad0d-856575198d8d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.069416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.069668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.070273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.070273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.070885 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.072895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.079353 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.081115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:13.103075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1280/2554] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:12 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:13.104132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.116632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1e88-7930-4cc5-bd17-d7012148093c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.123196 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.124149 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.124503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.124780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.125443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.127046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.150680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1281/2555] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:13.152252 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.163348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e19f1f-5c35-4403-a854-71c6b5aea1ff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.169078 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.169822 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.170768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.171179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] PATH_INFO: `/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb/users/48ad873453b74edbb45bf3e79fba22ba/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.173077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:13.181179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17a897-c0b1-41be-8394-5832cca93e68 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.189840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.190374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.190762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.191047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.196545 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f7bb14d9f427b9cd0d8a1e2cba2bb, user_id=48ad873453b74edbb45bf3e79fba22ba, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.199344 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.203551 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.205105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.214900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1282/2556] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:13 2022] PUT /identity/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb/users/48ad873453b74edbb45bf3e79fba22ba/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:13.216584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1275/2557] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:09:13.220689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.277699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:13.361773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f612b4-a9bc-4184-a0ca-cbd0c903bd9d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.375165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.381633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.382709 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.383227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.384142 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.386057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c56a1-674a-4520-a398-892bb25d0664 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.401292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1283/2558] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:13.406549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.424768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83aa9a-32a4-4b74-a49a-02003103df6a service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.436668 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.437821 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.438275 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.438721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] PATH_INFO: `/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb/users/48ad873453b74edbb45bf3e79fba22ba/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.444261 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64f7bb14d9f427b9cd0d8a1e2cba2bb, user_id=48ad873453b74edbb45bf3e79fba22ba, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.447656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.464737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1276/2559] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:13 2022] PUT /identity/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb/users/48ad873453b74edbb45bf3e79fba22ba/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:13.477927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.478310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.478962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.532994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] MFA Rules not processed for user `48ad873453b74edbb45bf3e79fba22ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:13.534614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:13.622710 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1284/2560] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:13.641172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.643416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:13.731370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613f1a2-e93a-4bdb-a93e-6c1391e99e29 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.736363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.737638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.738006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.738294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.749404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.750999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.761779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1277/2561] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:13.820171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:13.821634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:13.835793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7b630-4980-469f-a77d-a03890e0a5fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:13.839740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:13.840433 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:13.840753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:13.841082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:13.914852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:13.918532 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:13.927618 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1285/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:14.511193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:14.513513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:14.624441 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae294d-48f2-49ca-a6b4-3029bd36d6b6 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:14.636079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:14.638089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:14.638089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:14.638089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:14.640126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:14.661837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:14.663680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:14.677437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1278/2563] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:17.638595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:17.638595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:17.712175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:17.726193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5cec-ac46-4599-9f6a-1c8c95bf141e service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:17.730762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:17.731615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:17.732077 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:17.733229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:17.737429 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:17.782153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:17.850011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:17.852641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41daf-8af8-4f95-beff-ebb28016a6be service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:17.867771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1286/2564] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:17.880191 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd17f9-f211-46f9-99be-f44f3fdf8e03 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:17.889730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:17.890420 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:17.890706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:17.890959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] PATH_INFO: `/v3/users/f94f1dd060904cfba72278c3b3f3fef6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:17.892606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94f1dd060904cfba72278c3b3f3fef6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:17.895333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:17.902705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:17.983901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94f1dd060904cfba72278c3b3f3fef6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:17.996909 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94f1dd060904cfba72278c3b3f3fef6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:17.998002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94f1dd060904cfba72278c3b3f3fef6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:17.998921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94f1dd060904cfba72278c3b3f3fef6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:18.007762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94f1dd060904cfba72278c3b3f3fef6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:18.039348 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:18.039659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:18.039938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:18.045077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1279/2565] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:17 2022] DELETE /identity/v3/users/f94f1dd060904cfba72278c3b3f3fef6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:18.062397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:18.063636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:18.135800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1287/2566] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:18.145308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:18.147683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:18.242548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85aea2-138f-44c6-bd2e-c315f828cfe8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:18.248953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:18.252150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:18.252692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:18.253197 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:18.265849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:18.272865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:18.289324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1280/2567] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:09:18.917045 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:18.918676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:18.937399 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e22f-4f9a-4690-be4c-5bc21b1000dd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:18.942940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:18.943586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:18.943872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:18.945352 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] PATH_INFO: `/v3/projects/3fab935b0ba04f04ba2a5afa4814c9e9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:18.947262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fab935b0ba04f04ba2a5afa4814c9e9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:18.949307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:19.039317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fab935b0ba04f04ba2a5afa4814c9e9', 'request_id': 'req-01a6f447-6226-4900-afab-eb2aa72b94d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.052346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fab935b0ba04f04ba2a5afa4814c9e9', 'request_id': 'req-01a6f447-6226-4900-afab-eb2aa72b94d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.065126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fab935b0ba04f04ba2a5afa4814c9e9', 'request_id': 'req-01a6f447-6226-4900-afab-eb2aa72b94d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.092270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] The token cache is being invalidate because project 3fab935b0ba04f04ba2a5afa4814c9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:19.092658 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.093280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.095530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1288/2568] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:18 2022] DELETE /identity/v3/projects/3fab935b0ba04f04ba2a5afa4814c9e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:19.099589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:19.111243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b558-3168-4458-9d4c-fcd21234ed57 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:19.220076 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:19.222732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:19.222921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:19.223857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] PATH_INFO: `/v3/users/48ad873453b74edbb45bf3e79fba22ba` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:19.225787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ad873453b74edbb45bf3e79fba22ba)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:19.230081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:19.279117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:19.323383 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ad873453b74edbb45bf3e79fba22ba'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.344464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ad873453b74edbb45bf3e79fba22ba'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.345138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ad873453b74edbb45bf3e79fba22ba'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.345801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ad873453b74edbb45bf3e79fba22ba'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.360779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a3266fa7-4441-4b94-bea1-6d9346bf6ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ad873453b74edbb45bf3e79fba22ba'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:19.405500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1281/2569] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:19 2022] DELETE /identity/v3/users/48ad873453b74edbb45bf3e79fba22ba => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:19.863299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:19.865008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:19.890389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6f447-6226-4900-afab-eb2aa72b94d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:19.914084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.059736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.062020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.062452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.062878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] PATH_INFO: `/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.067049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64f7bb14d9f427b9cd0d8a1e2cba2bb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.072160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.163926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64f7bb14d9f427b9cd0d8a1e2cba2bb', 'request_id': 'req-7f827371-583c-4f7e-bec4-406d359cd7c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:20.179692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64f7bb14d9f427b9cd0d8a1e2cba2bb', 'request_id': 'req-7f827371-583c-4f7e-bec4-406d359cd7c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:20.189231 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64f7bb14d9f427b9cd0d8a1e2cba2bb', 'request_id': 'req-7f827371-583c-4f7e-bec4-406d359cd7c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:20.205143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] The token cache is being invalidate because project f64f7bb14d9f427b9cd0d8a1e2cba2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:20.205730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:20.206408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7f827371-583c-4f7e-bec4-406d359cd7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:20.208267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1289/2570] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:19 2022] DELETE /identity/v3/projects/f64f7bb14d9f427b9cd0d8a1e2cba2bb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:20.216006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.216006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.216006 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.250095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:20.257506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:20.353557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.353557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.353557 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.366571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1282/2571] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:20.378579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:20.380120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:20.395946 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.406535 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1290/2572] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:20.409561 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b99d-4419-4995-aa3a-0fbdeb114fd2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.415099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.415842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.416221 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.416732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.417513 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:20.417913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.420403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.439443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1283/2573] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:20.439888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.449863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1cff3-3824-40ac-b317-8344db678a3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.456075 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.456857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.457574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.457574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.458368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.460686 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.503225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1291/2574] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:20 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:20.503681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.517153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4db2-7a31-4112-baa5-82b2631b272a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.602392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.603017 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.603382 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.603765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.604705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.607097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.641200 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1284/2575] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:20 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:20.645384 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.659767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df047-a853-4548-be5b-77fbd4144296 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.666607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.667620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.668019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.668590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.670031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.672179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.694323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1292/2576] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:09:20.698360 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.724618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b1a80-bf97-4989-8c71-1d8ff19720d7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.772517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.772517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.772517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.772517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.779301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.782916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f00829-ec01-412c-8663-b195dc479dbe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.818823 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1285/2577] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:20.822160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:20.847001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538036-c486-4be3-91e1-905808483b7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:20.859479 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:20.860873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.861260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.861906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] PATH_INFO: `/v3/projects/5a4ff33821fe4da4a75b9d3191693b95/users/e6096c1411444b458af91fc0af5559df/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.884217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4ff33821fe4da4a75b9d3191693b95, user_id=e6096c1411444b458af91fc0af5559df, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:20.887543 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:20.927713 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1293/2578] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:20 2022] PUT /identity/v3/projects/5a4ff33821fe4da4a75b9d3191693b95/users/e6096c1411444b458af91fc0af5559df/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:20.939672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:20.940271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:20.940579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:20.975758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:20.992002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] MFA Rules not processed for user `e6096c1411444b458af91fc0af5559df`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:20.993846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:21.161538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1286/2579] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:21.175150 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:21.185100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:21.295153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:21.335117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc9805-0119-4edc-bb1c-41d638796b9f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:21.340689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:21.342408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:21.343355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:21.343850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:21.362933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:21.366633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:21.380212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1294/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:23.263423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:23.265746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:23.564632 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e2519-b57c-4499-b649-70b08f274ca2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:23.569812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:23.570472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:23.570788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:23.571028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] PATH_INFO: `/v3/users/508fe245e731449da94b0a7abf895f8f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:23.572364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=508fe245e731449da94b0a7abf895f8f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:23.574555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:23.674576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508fe245e731449da94b0a7abf895f8f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:23.705559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508fe245e731449da94b0a7abf895f8f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:23.706554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508fe245e731449da94b0a7abf895f8f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:23.707276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508fe245e731449da94b0a7abf895f8f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:23.723676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a02be58c-34c0-4524-afae-45d37f07d3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508fe245e731449da94b0a7abf895f8f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:23.750031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1287/2581] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:23 2022] DELETE /identity/v3/users/508fe245e731449da94b0a7abf895f8f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:23.994787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.014031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8a7b-7247-4a9c-961b-893fb9715255 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.130262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.131393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.131914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.132406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] PATH_INFO: `/v3/projects/6dabf25d5f3d47439797c23bb3627520` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.134637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dabf25d5f3d47439797c23bb3627520)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.139218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.219127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dabf25d5f3d47439797c23bb3627520', 'request_id': 'req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:24.227834 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dabf25d5f3d47439797c23bb3627520', 'request_id': 'req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:24.239031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dabf25d5f3d47439797c23bb3627520', 'request_id': 'req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:24.260277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] The token cache is being invalidate because project 6dabf25d5f3d47439797c23bb3627520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:24.260523 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:24.261171 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0e45f79d-1dc6-4461-8c8e-f0e21ca3afb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:24.263038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1295/2582] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:23 2022] DELETE /identity/v3/projects/6dabf25d5f3d47439797c23bb3627520 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:24.273061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.274195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.274644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.305788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:24.307486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:24.325466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:24.414760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1288/2583] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:24.416614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.416883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.417136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.468025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:24.469597 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:24.487859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1296/2584] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:24.492280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.519266 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7181b89-4a9f-42ec-8a94-3cd513140a74 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.529380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.530027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.530306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.530580 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.531302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:24.531648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.534252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.552877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1289/2585] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:24.555818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.570518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f8e30-4ffe-4047-bca5-223567163ee4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.576260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.577141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.577495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.577829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.578563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.580984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.619805 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1297/2586] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:24 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:24.628938 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.641373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbbd7b4-7e8a-4283-a3ef-4c162487b3a1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.748403 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.749231 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.749604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.750163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.750894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.753791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.781471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1290/2587] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:24 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:09:24.787930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.807246 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53a0d-2abd-419d-a6fd-15cfaecc8eb3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.818010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.819428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.820098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.820787 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.822602 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.827413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.851615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1298/2588] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:24.853620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.869457 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fbe79-8856-4a9a-bc7e-44021c81035e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.875346 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.875977 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.876256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.876559 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.877434 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.879172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69b7e-fc14-408f-aee3-476c0e98189b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.895193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1291/2589] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:24.899371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:24.910656 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39d5ae-367a-499a-8ba4-ddac9ec27352 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:24.915971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:24.916831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.917210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.917687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] PATH_INFO: `/v3/projects/6924e29077f94a408051c3e0d98f49a7/users/dad205cc78f8493196ff5856fbe9d3d1/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.934736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6924e29077f94a408051c3e0d98f49a7, user_id=dad205cc78f8493196ff5856fbe9d3d1, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:24.938269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:24.955741 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1299/2590] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:24 2022] PUT /identity/v3/projects/6924e29077f94a408051c3e0d98f49a7/users/dad205cc78f8493196ff5856fbe9d3d1/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:24.962336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:24.963096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:24.963796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:24.990674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:24.991892 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:25.075501 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1292/2591] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:09:25.086038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:25.088432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:25.105873 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:25.161397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd22ec-1208-4005-88c1-318043b7d8ab admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:25.165891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:25.166497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:25.166776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:25.167049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:25.178650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:25.182213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2048ba1-200b-4530-92d4-e30f4fa92993 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:25.197896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1300/2592] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:25.202646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:25.204047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:25.218357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ceb43-e42f-4ee2-bd1f-7b6aab069c86 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:25.225750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:25.227214 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:25.227813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:25.228753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] PATH_INFO: `/v3/users/e6096c1411444b458af91fc0af5559df` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:25.229754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6096c1411444b458af91fc0af5559df)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:25.231736 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:25.259259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:25.289947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6096c1411444b458af91fc0af5559df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:25.299140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6096c1411444b458af91fc0af5559df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:25.300042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6096c1411444b458af91fc0af5559df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:25.301120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6096c1411444b458af91fc0af5559df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:25.311178 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6096c1411444b458af91fc0af5559df'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:25.340032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1293/2593] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:09:25 2022] DELETE /identity/v3/users/e6096c1411444b458af91fc0af5559df => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:25.346037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:25.346321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:25.346643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:25.371503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:25.373763 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:25.443504 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1301/2594] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:25.454070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:25.455844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:25.529414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63576d5c-bacd-434e-973a-a6be1176e794 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:25.535506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:25.536140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:25.536423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:25.536746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:25.548449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:25.549974 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12324495-48dc-4d27-852c-311652c57de8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:25.569419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1294/2595] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:26.214325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.215934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:26.230031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd77fb-cb6f-430b-bd56-7815593b3424 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.236382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.237668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.238160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.238655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] PATH_INFO: `/v3/projects/5a4ff33821fe4da4a75b9d3191693b95` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.240176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4ff33821fe4da4a75b9d3191693b95)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.243427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.322392 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4ff33821fe4da4a75b9d3191693b95', 'request_id': 'req-f9329fc5-e4f6-4612-8030-0616edc22d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:26.332843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4ff33821fe4da4a75b9d3191693b95', 'request_id': 'req-f9329fc5-e4f6-4612-8030-0616edc22d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:26.344592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4ff33821fe4da4a75b9d3191693b95', 'request_id': 'req-f9329fc5-e4f6-4612-8030-0616edc22d95'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:26.364757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] The token cache is being invalidate because project 5a4ff33821fe4da4a75b9d3191693b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:09:26.365052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:26.365964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f9329fc5-e4f6-4612-8030-0616edc22d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:09:26.371212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1302/2596] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:09:26 2022] DELETE /identity/v3/projects/5a4ff33821fe4da4a75b9d3191693b95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:09:26.372878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.373443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.373443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.396566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:26.398900 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:26.500522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1295/2597] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:26.506476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.507041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.507505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.543631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:26.546428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:26.557341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1303/2598] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:26.562603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.573509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335eb8-94bc-46ac-b859-8eca14cc4576 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.579897 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.580705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.581482 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.581763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.582620 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:09:26.582754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.584438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.598188 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1296/2599] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:09:26.603132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.616167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aa704-7aa8-48e1-a6b5-d328082a284a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.626110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.627395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.628143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.628683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.629604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.632018 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.685629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1304/2600] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:09:26 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:26.691565 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.704080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875340d9-a2ed-452e-82fb-f6eb4046dc1a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.743133 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:26.804278 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.805182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.805462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.805735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.806532 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.808557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.844226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1297/2601] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:09:26 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:09:26.845933 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.871699 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a19c-6fe0-4c9b-b27f-0d993fcd0c98 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.891968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.893360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.893930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.894416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.895477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.903603 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.915790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:26.922831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1305/2602] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:26.927543 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.942343 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c41ba-5a74-4d96-abc9-c482696b5c70 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.947571 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.948186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.948679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.948956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:26.949616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:26.952056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492150d7-ad69-4b27-906f-abfc53ee9383 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:26.963911 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1298/2603] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:09:26.968984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:26.985750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7a19-ffbd-475c-8be7-4de849b52a8e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:26.991177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:26.991831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:26.992148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:26.992378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] PATH_INFO: `/v3/projects/d85416782ff748a680247f014134d0fa/users/20261c0709af4813abc732e709bc0d64/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:27.010154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85416782ff748a680247f014134d0fa, user_id=20261c0709af4813abc732e709bc0d64, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:27.012712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:27.055177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1306/2604] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:09:26 2022] PUT /identity/v3/projects/d85416782ff748a680247f014134d0fa/users/20261c0709af4813abc732e709bc0d64/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:09:27.070176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0713b6-fef2-47ea-8e61-65df2feeecd1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:27.070515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0713b6-fef2-47ea-8e61-65df2feeecd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:27.070738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0713b6-fef2-47ea-8e61-65df2feeecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:27.101517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-da0713b6-fef2-47ea-8e61-65df2feeecd1 None None] MFA Rules not processed for user `20261c0709af4813abc732e709bc0d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:27.102929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da0713b6-fef2-47ea-8e61-65df2feeecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:27.204721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1299/2605] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:27.215556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:27.218103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:27.287583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07db7c8-a44e-494e-9d16-0b403c2d8fb4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:27.296409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:27.296409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:27.296409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:27.296409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:27.303897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:27.305372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:27.315571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1307/2606] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:28.735915 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35316-5f5e-4ca1-b301-c7e9698f039a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:28.736581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35316-5f5e-4ca1-b301-c7e9698f039a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:28.736581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35316-5f5e-4ca1-b301-c7e9698f039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:28.774443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ccb35316-5f5e-4ca1-b301-c7e9698f039a None None] MFA Rules not processed for user `20261c0709af4813abc732e709bc0d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:28.776554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccb35316-5f5e-4ca1-b301-c7e9698f039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:28.788752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1300/2607] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:29.507562 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:29.510343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:29.621559 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bca57-f824-48c8-9761-1e573e6d5394 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:29.627689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:29.628317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:29.628637 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:29.628911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:29.630715 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:29.644690 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:29.646347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:29.657439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1308/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:30.261976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106477a-eb7e-439e-8e4a-36f01d8295fa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:30.262526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106477a-eb7e-439e-8e4a-36f01d8295fa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:30.262718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106477a-eb7e-439e-8e4a-36f01d8295fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:30.317576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d106477a-eb7e-439e-8e4a-36f01d8295fa None None] MFA Rules not processed for user `dad205cc78f8493196ff5856fbe9d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:30.319202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d106477a-eb7e-439e-8e4a-36f01d8295fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:30.440407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1301/2609] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:30.449434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:30.451906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:30.574213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195107-c95b-4a70-8c91-dadab3606da6 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:30.589930 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:30.590780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:30.591280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:30.591756 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:30.598798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:30.611906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:30.613534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:30.626617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1309/2610] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:32.913699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f7bb-b92a-44d6-99e8-397a757b8955 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:32.914144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f7bb-b92a-44d6-99e8-397a757b8955 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:32.914264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67f7bb-b92a-44d6-99e8-397a757b8955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:32.970947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0a67f7bb-b92a-44d6-99e8-397a757b8955 None None] MFA Rules not processed for user `dad205cc78f8493196ff5856fbe9d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:32.974073 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0a67f7bb-b92a-44d6-99e8-397a757b8955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:32.994581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1302/2611] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:09:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:33.791098 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:33.792592 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:33.868403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e8-65de-45f0-8aa7-48d51ba35bbb service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:33.874439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:33.875064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:33.875493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:33.875769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:33.877749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:33.895021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:33.896574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:33.907935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1310/2612] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:09:34.763999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4f6a-ab3c-45b0-80b0-da36480a7ca9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:34.764511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4f6a-ab3c-45b0-80b0-da36480a7ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:34.764896 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c4f6a-ab3c-45b0-80b0-da36480a7ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:34.807869 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7a3c4f6a-ab3c-45b0-80b0-da36480a7ca9 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:34.809125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7a3c4f6a-ab3c-45b0-80b0-da36480a7ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:34.820460 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:34.938609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1303/2613] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:09:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:34.963056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:34.965291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:35.078893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff685f7-91ea-4f61-bd01-897af28edab9 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:35.087975 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:35.089095 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:35.089372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:35.089711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:35.106324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:35.109113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:35.121640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1311/2614] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 17:09:44.926355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=19 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:45.116994 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=61 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:09:54.818350 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:54.818881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:54.818881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:54.844265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:54.846134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:54.858757 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1304/2615] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:09:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:54.885495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:54.902022 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e7ad0-a07f-4ad9-b730-a4807c7063e1 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:54.909780 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:54.911015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:54.911518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:54.912912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:54.929695 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:54.931727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc692be-ba5e-475e-9ed4-26944a9f4c74 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:54.942420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1312/2616] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:57.853401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:57.854899 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:57.872291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7651c6-e2ad-481a-b507-5be5a2fa05db None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:57.878237 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:57.878947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:57.879297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:57.879638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:57.881508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:57.894598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:57.896267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:57.908879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1305/2617] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:09:58.215041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cac5-c737-4aaf-9ee0-e402249407c0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:58.215550 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cac5-c737-4aaf-9ee0-e402249407c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:58.215747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6cac5-c737-4aaf-9ee0-e402249407c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:58.235883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0af6cac5-c737-4aaf-9ee0-e402249407c0 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:58.237338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0af6cac5-c737-4aaf-9ee0-e402249407c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:58.246006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1313/2618] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:58.263087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:58.274637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fbbf7-ed04-4cd9-8acb-2427fa74606d service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:58.279616 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:58.280257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:58.280567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:58.280840 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:58.290318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:58.291917 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:58.301588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1306/2619] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:58.875698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464af4d-c47b-41dd-b13d-ae059934b8d6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:58.876132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464af4d-c47b-41dd-b13d-ae059934b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:58.876497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464af4d-c47b-41dd-b13d-ae059934b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:58.895531 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6464af4d-c47b-41dd-b13d-ae059934b8d6 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:58.897001 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6464af4d-c47b-41dd-b13d-ae059934b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:58.905013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1314/2620] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:09:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:58.917660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:58.928893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80879e-2ef7-4096-8c0f-5eb97ac2585f service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:58.934811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:58.935622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:58.935926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:58.936206 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:58.950408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:58.952004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:58.961416 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1307/2621] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:59.183902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73e68-f695-44c2-9102-726fe8c90275 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:59.183902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73e68-f695-44c2-9102-726fe8c90275 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:59.183902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73e68-f695-44c2-9102-726fe8c90275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:59.201240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f4a73e68-f695-44c2-9102-726fe8c90275 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:59.202413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f4a73e68-f695-44c2-9102-726fe8c90275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:59.209973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1315/2622] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 10 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:59.221937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:59.233492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b9ea-474d-4d38-ba51-45c11a77ea23 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:59.238508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:59.239089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:59.239367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:59.239636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:59.248132 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:59.249739 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:59.257555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1308/2623] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:09:59.578606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:59.579076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:59.579172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:59.599131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] MFA Rules not processed for user `1e26dcedde9c427c86879a5d1516305c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:09:59.600326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:09:59.607431 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1316/2624] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 10 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:09:59.619878 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:09:59.631136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e28d-db24-4d47-bee0-71f3e678412a service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:09:59.636070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11327e8df21f49039aab8222a571f1fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:09:59.636694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:09:59.637777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:09:59.638055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:09:59.645854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:09:59.647408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de72bc-45a4-43ed-84e5-e1f58c6d5ece service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:09:59.655638 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1309/2625] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 10 17:09:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 17:10:01.749720 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:01.812032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff5c81-f52a-4f27-a194-77a4a9ba0155 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:01.816506 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:01.817138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:01.817417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:01.817696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] PATH_INFO: `/v3/users/20261c0709af4813abc732e709bc0d64` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:01.818806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20261c0709af4813abc732e709bc0d64)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:01.820771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:01.866922 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20261c0709af4813abc732e709bc0d64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:01.878721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20261c0709af4813abc732e709bc0d64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:01.885362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20261c0709af4813abc732e709bc0d64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:01.886025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20261c0709af4813abc732e709bc0d64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:01.886663 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20261c0709af4813abc732e709bc0d64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:01.899317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1317/2626] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:10:01 2022] DELETE /identity/v3/users/20261c0709af4813abc732e709bc0d64 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:01.904363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:01.905096 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:01.905204 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:01.924831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:01.926019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:01.982921 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1310/2627] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:01.992386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:01.993801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:02.036944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:02.052086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda2753-0ada-4fa5-b06e-a036bfc83d20 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:02.055807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:02.056408 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:02.056783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:02.057049 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:02.066522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:02.067920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:02.077832 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1318/2628] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:02.244163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:02.245613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:02.257229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7099-b134-49c4-8d2a-147f6d77fc64 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:02.261741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:02.262393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:02.262681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:02.262932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] PATH_INFO: `/v3/projects/d85416782ff748a680247f014134d0fa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:02.264641 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85416782ff748a680247f014134d0fa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:02.266548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:02.314354 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85416782ff748a680247f014134d0fa', 'request_id': 'req-f93e066e-3489-4454-8ae3-b23a476e2f06'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:02.319716 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85416782ff748a680247f014134d0fa', 'request_id': 'req-f93e066e-3489-4454-8ae3-b23a476e2f06'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:02.327618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85416782ff748a680247f014134d0fa', 'request_id': 'req-f93e066e-3489-4454-8ae3-b23a476e2f06'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:02.338772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] The token cache is being invalidate because project d85416782ff748a680247f014134d0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:10:02.339056 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:02.339675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:02.341207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1311/2629] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:10:02 2022] DELETE /identity/v3/projects/d85416782ff748a680247f014134d0fa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:12.072968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:12.335858 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:37.525002 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:37.526391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:37.538782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048a060-2b49-4b94-a56a-d905b3d213ed service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:37.587405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:37.588006 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:37.588285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:37.588586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:37.590343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:37.652642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:37.654629 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:37.664810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1319/2630] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:40.517193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:40.519228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:40.535745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e066e-3489-4454-8ae3-b23a476e2f06 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:40.545660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:40.546493 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:40.546771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:40.547041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] PATH_INFO: `/v3/users/955e27b73d0f42698dcb99d7f3be3178` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:40.548164 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955e27b73d0f42698dcb99d7f3be3178)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:40.550172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:40.597882 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955e27b73d0f42698dcb99d7f3be3178'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:40.604888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955e27b73d0f42698dcb99d7f3be3178'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:40.605509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955e27b73d0f42698dcb99d7f3be3178'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:40.606112 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955e27b73d0f42698dcb99d7f3be3178'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:40.613091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-56ba7b2f-a01d-4a9f-91f4-2f65cd078ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955e27b73d0f42698dcb99d7f3be3178'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:40.630405 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1312/2631] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:10:40 2022] DELETE /identity/v3/users/955e27b73d0f42698dcb99d7f3be3178 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:41.068961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.084855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcc28-3fda-4184-b746-6e4c1aeaa33d service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.142449 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.143068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.143341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.143607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] PATH_INFO: `/v3/projects/018c96b8bfae4a0b92be12154d81d83a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.144743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018c96b8bfae4a0b92be12154d81d83a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.146793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.191671 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018c96b8bfae4a0b92be12154d81d83a', 'request_id': 'req-e3043115-8ae2-4bba-b75b-701e6b4b5251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:41.193721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:41.198694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018c96b8bfae4a0b92be12154d81d83a', 'request_id': 'req-e3043115-8ae2-4bba-b75b-701e6b4b5251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:41.205851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018c96b8bfae4a0b92be12154d81d83a', 'request_id': 'req-e3043115-8ae2-4bba-b75b-701e6b4b5251'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:41.219085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] The token cache is being invalidate because project 018c96b8bfae4a0b92be12154d81d83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:10:41.219371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:41.219995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e3043115-8ae2-4bba-b75b-701e6b4b5251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:41.221529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1320/2632] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:10:41 2022] DELETE /identity/v3/projects/018c96b8bfae4a0b92be12154d81d83a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:41.226439 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.226729 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.227002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.246735 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:41.248673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:41.310521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1313/2633] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:41.318571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.318855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.319125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.339318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:41.340537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:41.349036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1321/2634] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:10:41.353570 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.363879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5ee2-9b06-4928-a8bf-3fefa5f7c816 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.368619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.369212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.369490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.369761 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.370407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:10:41.371159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.372793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.384916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1314/2635] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:10:41.389273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.398237 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223084-b44b-4a4b-82c1-d1b1c9c38b3e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.402985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.403572 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.404365 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.404678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.405309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.407181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.438829 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1322/2636] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:10:41.443183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.454520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bd8-f61b-42e7-8acd-18bdf30b0702 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.519519 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.520198 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.521229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.521229 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.525091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.527408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.538069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:41.567440 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1315/2637] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/users => generated 278 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:10:41.571903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.584561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43cc8-6f7b-4cb8-b6a3-55ab5e629a6e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.594719 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.595341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.595790 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.596061 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.596754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.598513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.609942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1323/2638] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:41.614250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.624435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2039f-cee6-49ce-9bab-1ee6f51c58cb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.629157 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.629767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.630051 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.630370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.630975 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.632643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50363d7-eabb-43b0-b317-2081491c2ecc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.644301 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1316/2639] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:41.648411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.659588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e583cc-725e-4b5c-91f6-a9d6734a7038 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.665360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.666154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.666558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.666835 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] PATH_INFO: `/v3/projects/7e5a1e6378894f2680b7dc270c194ff4/users/dec267153a3148c0b8f23d1180f7d6cf/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.681281 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5a1e6378894f2680b7dc270c194ff4, user_id=dec267153a3148c0b8f23d1180f7d6cf, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.683906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.697133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1324/2640] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:10:41 2022] PUT /identity/v3/projects/7e5a1e6378894f2680b7dc270c194ff4/users/dec267153a3148c0b8f23d1180f7d6cf/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:41.708854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.709079 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.709349 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.738898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] MFA Rules not processed for user `dec267153a3148c0b8f23d1180f7d6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:41.740102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:41.802683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1317/2641] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:41.807278 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.868901 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47369c-8690-4f3f-a979-e7e5193620dd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.873640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.874229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.874510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.874783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.875402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.877314 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:41.903482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1325/2642] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:10:41.908159 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:41.918955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4235c47-157a-4291-a18d-38b0f8c4487c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:41.975609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:41.976100 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:41.976385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:41.976676 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:41.977291 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:41.979187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.001718 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1318/2643] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:10:41 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:10:42.005948 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.017014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d912a-475a-413f-b0d8-74696d6cff7b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.021638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.022227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.022505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.022775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.023413 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.025044 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.037306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1326/2644] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:42.041702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.052182 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678105ed-7e22-4ec4-9394-e975dd943f06 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.057038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.057698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.057978 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.058247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] PATH_INFO: `/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d/users/8668a2d5fec2441fa4be3c34cf1311f9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.073845 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff5084912847bebf5b1c4ff46cad3d, user_id=8668a2d5fec2441fa4be3c34cf1311f9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.077335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.089867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1319/2645] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:10:42 2022] PUT /identity/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d/users/8668a2d5fec2441fa4be3c34cf1311f9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:42.094163 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.104126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4625-ac86-4e8d-aeb4-6021a9acd784 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.150209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:42.161282 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.162043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.162381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.162844 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.163493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.165153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c01dcf-6dff-4d6a-9b71-d945f7e735d5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.174811 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1327/2646] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:42.179209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.190054 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa900b2-78e0-42e1-bd70-4872bf7f5cfb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.194740 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.195385 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.195665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.195937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] PATH_INFO: `/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d/users/8668a2d5fec2441fa4be3c34cf1311f9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.197956 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff5084912847bebf5b1c4ff46cad3d, user_id=8668a2d5fec2441fa4be3c34cf1311f9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.200607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.211247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1320/2647] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:10:42 2022] PUT /identity/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d/users/8668a2d5fec2441fa4be3c34cf1311f9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:42.223209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.223492 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.223764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.251465 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] MFA Rules not processed for user `8668a2d5fec2441fa4be3c34cf1311f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:42.252616 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:42.319229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1328/2648] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:42.332171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.333883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:42.356549 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:42.393355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518dc0c-7864-4de8-a6f6-de6ae98108d7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.396980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.397575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.397846 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.398110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.407175 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.408617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0db4e-e734-4bb0-a626-d52ec708407c service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.419010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1321/2649] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:42.494738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:42.505253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffed41-2013-4dbb-ba9c-5039e9bada20 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:42.508747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:42.509336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:42.509609 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:42.509877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:42.565495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:42.566911 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:42.576025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1329/2650] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:46.447450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:46.447980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:46.448075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:46.469407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] MFA Rules not processed for user `dad205cc78f8493196ff5856fbe9d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:46.470597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:46.527172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1322/2651] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:46.850916 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:46.852366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:46.910288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad51c7-e3fe-4262-9af1-c99bc570a4af service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:46.914093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:46.914529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:46.914809 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:46.915079 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:46.916893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:46.927182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:46.928630 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55b098-497c-49e6-b3f1-758458b333f6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:46.937210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1330/2652] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:56.520030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=42 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:56.933041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:57.536933 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:57.641045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9536e7-00d5-48a0-a5e4-1a06fd01a8b6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:57.645653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:57.646279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:57.646560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:57.646825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] PATH_INFO: `/v3/users/dec267153a3148c0b8f23d1180f7d6cf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:57.648053 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec267153a3148c0b8f23d1180f7d6cf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:57.650424 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:57.698483 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec267153a3148c0b8f23d1180f7d6cf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:57.707357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec267153a3148c0b8f23d1180f7d6cf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:57.708021 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec267153a3148c0b8f23d1180f7d6cf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:57.708781 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec267153a3148c0b8f23d1180f7d6cf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:57.715767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec267153a3148c0b8f23d1180f7d6cf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:57.732645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1323/2653] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:10:57 2022] DELETE /identity/v3/users/dec267153a3148c0b8f23d1180f7d6cf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:57.737360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:57.737666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:57.737937 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:57.788693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:57.790221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:57.849415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1331/2654] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:57.859885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:57.862028 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:57.905809 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:57.941851 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937494-e77f-4878-8d66-428cb80a5313 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:57.945452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:57.946050 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:57.946329 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:57.946602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:57.956904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:57.958333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:57.967782 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1324/2655] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:10:58.297480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:58.299249 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:58.315716 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72670caf-0429-4df6-9477-3ae91e6e885f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:58.320388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:58.321168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:58.321540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:58.321902 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] PATH_INFO: `/v3/projects/7e5a1e6378894f2680b7dc270c194ff4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:58.323917 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5a1e6378894f2680b7dc270c194ff4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:58.326403 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:58.377565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5a1e6378894f2680b7dc270c194ff4', 'request_id': 'req-521cb12d-c7a6-4703-8407-4ad9823d578c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.385130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5a1e6378894f2680b7dc270c194ff4', 'request_id': 'req-521cb12d-c7a6-4703-8407-4ad9823d578c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.392133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5a1e6378894f2680b7dc270c194ff4', 'request_id': 'req-521cb12d-c7a6-4703-8407-4ad9823d578c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.405522 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] The token cache is being invalidate because project 7e5a1e6378894f2680b7dc270c194ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:10:58.405821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.406473 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.407962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1332/2656] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:10:58 2022] DELETE /identity/v3/projects/7e5a1e6378894f2680b7dc270c194ff4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:58.412171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:58.425099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208c04b-97fc-4058-b9e8-916c447e2c5c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:58.489646 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:58.490320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:58.490603 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:58.490876 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] PATH_INFO: `/v3/users/8668a2d5fec2441fa4be3c34cf1311f9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:58.492025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8668a2d5fec2441fa4be3c34cf1311f9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:58.494114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:58.547196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8668a2d5fec2441fa4be3c34cf1311f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.555160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8668a2d5fec2441fa4be3c34cf1311f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.555788 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8668a2d5fec2441fa4be3c34cf1311f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.556412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8668a2d5fec2441fa4be3c34cf1311f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.566437 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1267dfeb-5276-4ab5-836f-a66357bfad7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8668a2d5fec2441fa4be3c34cf1311f9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:58.590242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1325/2657] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:10:58 2022] DELETE /identity/v3/users/8668a2d5fec2441fa4be3c34cf1311f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:10:59.146767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.148793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:59.165417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb12d-c7a6-4703-8407-4ad9823d578c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.233051 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:59.241838 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.242664 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.243621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.244071 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] PATH_INFO: `/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.246659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ff5084912847bebf5b1c4ff46cad3d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.249070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.324247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ff5084912847bebf5b1c4ff46cad3d', 'request_id': 'req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:59.334442 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ff5084912847bebf5b1c4ff46cad3d', 'request_id': 'req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:59.341837 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ff5084912847bebf5b1c4ff46cad3d', 'request_id': 'req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:59.361796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] The token cache is being invalidate because project a4ff5084912847bebf5b1c4ff46cad3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:10:59.362086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:59.362971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b7ad0b7b-d3b4-4dff-a2e8-f9afd3bdcfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:10:59.364762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1333/2658] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:10:59 2022] DELETE /identity/v3/projects/a4ff5084912847bebf5b1c4ff46cad3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:10:59.369657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.369963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.370412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.433683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:59.435277 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:59.450766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:10:59.513008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1326/2659] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:59.521223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.521507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.521779 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.547160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:59.548586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:10:59.557019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1334/2660] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:10:59.561190 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.571535 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10d18a-10fb-4c82-994e-0a69ae812cae None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.577276 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.578446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.578828 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.579455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.580243 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:10:59.580435 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.582991 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.595984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1327/2661] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:10:59.600230 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.610464 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b0fb9-6872-414b-b655-6483678bb7b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.616117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.616770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.617040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.617311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.617951 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.620248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.651394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1335/2662] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:10:59 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:10:59.660038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.670423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b505dfd-976a-451d-bb8f-27d9a306bdd6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.747466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.748294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.748294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.748645 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.749213 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.751372 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.777771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1328/2663] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:10:59 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:10:59.782977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.793750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb21d89-afc1-49f0-9a80-8c46c1065dab admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.801200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.801904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.802253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.802593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.803318 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.805031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.818712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1336/2664] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:59.820298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.831825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84cc14-917c-44ea-896a-1ca37e50972e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.844966 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.845725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.846127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.846401 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.847044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.848727 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff42d-2b55-4495-bede-e0446eb8a914 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.862647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1329/2665] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:10:59.864003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:10:59.873944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908b7b-89ac-459e-bfd4-235a9fcf49fa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:10:59.880505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:10:59.881177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.881458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.881732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] PATH_INFO: `/v3/projects/fe9a7f9aa751440a9187d9983cd1d309/users/64c001e9d3f04003aada51b7e1c393fa/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.897499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9a7f9aa751440a9187d9983cd1d309, user_id=64c001e9d3f04003aada51b7e1c393fa, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:10:59.900214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:10:59.914253 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1337/2666] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:10:59 2022] PUT /identity/v3/projects/fe9a7f9aa751440a9187d9983cd1d309/users/64c001e9d3f04003aada51b7e1c393fa/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:10:59.926283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:10:59.926680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:10:59.927062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:10:59.965810 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] MFA Rules not processed for user `64c001e9d3f04003aada51b7e1c393fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:10:59.967015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:00.033194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1330/2667] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:10:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:00.037644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.101446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb49805-fb81-4c36-a7cc-5c0df224e517 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.106170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.106773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.107050 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.107322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.107956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.109964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.138053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1338/2668] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:00 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:00.142774 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.153947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc5d47-4e0a-43e3-9960-f244fdfb9bd4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.168417 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:00.216545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.217436 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.217714 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.217986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.218662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.220656 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.244870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1331/2669] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:00 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:00.248803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.260194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9236162-2607-4023-bce1-af6868095735 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.265287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.266687 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.267004 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.267274 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.267924 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.269544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.272537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:00.282889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1339/2670] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:00.287130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.298623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d33cf7-de43-4c45-9559-003de4392d25 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.310384 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.311080 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.311362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.311642 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] PATH_INFO: `/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0/users/20950a4c7e1649f5995361ce9f2b303b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.327752 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1dc2baafa74f478db4fd41b64ce8f0, user_id=20950a4c7e1649f5995361ce9f2b303b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.331003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.345661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1332/2671] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:00 2022] PUT /identity/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0/users/20950a4c7e1649f5995361ce9f2b303b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:00.349672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.361286 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7bb5-6285-466e-b364-080db572fe3b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.425185 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.425788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.426066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.426345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.426993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.428667 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ce9a-6ec1-4727-a88f-db1f7c66e7c6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.439539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1340/2672] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:00.443926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.455433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef0041-1587-48ce-92cc-e9a137c952e3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.460187 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.460879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.461181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.461449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] PATH_INFO: `/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0/users/20950a4c7e1649f5995361ce9f2b303b/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.463338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1dc2baafa74f478db4fd41b64ce8f0, user_id=20950a4c7e1649f5995361ce9f2b303b, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.465999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.476733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1333/2673] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:00 2022] PUT /identity/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0/users/20950a4c7e1649f5995361ce9f2b303b/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:00.488767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.489127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.489476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.518660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] MFA Rules not processed for user `20950a4c7e1649f5995361ce9f2b303b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:00.519968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:00.593299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1341/2674] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:00.605414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.607102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:00.664374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43503c31-eb19-4009-b4a8-db91243ebe5e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.668008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.668651 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.668928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.669196 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.677994 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.679421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.689377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1334/2675] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:00.774434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:00.784978 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe884cea-7ce8-40de-8b88-6a1165a241a4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:00.788623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:00.789212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:00.789486 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:00.789755 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:00.846614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:00.848038 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1653-fdef-4cf1-949b-2637cefc22a1 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:00.856778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1342/2676] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:05.572763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:05.634466 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b878-8c35-417c-a137-0f2aaad38e0a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:05.638979 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:05.639596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:05.639873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:05.640698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] PATH_INFO: `/v3/users/64c001e9d3f04003aada51b7e1c393fa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:05.641835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c001e9d3f04003aada51b7e1c393fa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:05.643738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:05.656704 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:05.690327 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c001e9d3f04003aada51b7e1c393fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:05.697060 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c001e9d3f04003aada51b7e1c393fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:05.697678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c001e9d3f04003aada51b7e1c393fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:05.698311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c001e9d3f04003aada51b7e1c393fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:05.706257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c001e9d3f04003aada51b7e1c393fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:05.724226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1335/2677] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:05 2022] DELETE /identity/v3/users/64c001e9d3f04003aada51b7e1c393fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:05.728770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:05.729217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:05.729336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:05.747696 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:05.748849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:05.762856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:05.815210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1343/2678] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:05.825038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:05.826470 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:05.884267 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06930a-8a73-4029-89f0-d7ab4df84f4d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:05.887926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:05.888534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:05.888830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:05.889097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:05.898120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:05.899562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:05.908731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1336/2679] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:06.188914 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:06.190425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:06.202388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530690c8-3316-448d-a2d8-7a0fd6a400ff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:06.207337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:06.207968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:06.208244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:06.208553 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] PATH_INFO: `/v3/projects/fe9a7f9aa751440a9187d9983cd1d309` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:06.209672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9a7f9aa751440a9187d9983cd1d309)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:06.211554 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:06.260104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9a7f9aa751440a9187d9983cd1d309', 'request_id': 'req-f8b449df-10b8-48cc-bd38-a83d3393b78b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.265513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9a7f9aa751440a9187d9983cd1d309', 'request_id': 'req-f8b449df-10b8-48cc-bd38-a83d3393b78b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.271568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9a7f9aa751440a9187d9983cd1d309', 'request_id': 'req-f8b449df-10b8-48cc-bd38-a83d3393b78b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.285524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] The token cache is being invalidate because project fe9a7f9aa751440a9187d9983cd1d309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:06.285814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.286440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.287928 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1344/2680] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:06 2022] DELETE /identity/v3/projects/fe9a7f9aa751440a9187d9983cd1d309 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:11:06.291902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:06.302181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce90f-f6b6-4038-a615-ef440145c3e8 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:06.357095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:06.357709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:06.357985 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:06.358252 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] PATH_INFO: `/v3/users/20950a4c7e1649f5995361ce9f2b303b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:06.359773 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=20950a4c7e1649f5995361ce9f2b303b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:06.361699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:06.398425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:06.410093 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20950a4c7e1649f5995361ce9f2b303b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.417753 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20950a4c7e1649f5995361ce9f2b303b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.418597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20950a4c7e1649f5995361ce9f2b303b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.419366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20950a4c7e1649f5995361ce9f2b303b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.426679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bcd5669e-f9f3-4c31-9b6f-797c81816fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20950a4c7e1649f5995361ce9f2b303b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.444099 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1337/2681] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:06 2022] DELETE /identity/v3/users/20950a4c7e1649f5995361ce9f2b303b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:06.708439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:06.709991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:06.723878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b449df-10b8-48cc-bd38-a83d3393b78b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:06.779776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:06.780414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:06.780694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:06.780966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] PATH_INFO: `/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:06.782065 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1dc2baafa74f478db4fd41b64ce8f0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:06.783973 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:06.830117 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:06.834165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1dc2baafa74f478db4fd41b64ce8f0', 'request_id': 'req-d6650976-de6c-45f9-a009-4d4cb6fd1050'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.840810 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1dc2baafa74f478db4fd41b64ce8f0', 'request_id': 'req-d6650976-de6c-45f9-a009-4d4cb6fd1050'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.846889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1dc2baafa74f478db4fd41b64ce8f0', 'request_id': 'req-d6650976-de6c-45f9-a009-4d4cb6fd1050'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.859026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] The token cache is being invalidate because project ba1dc2baafa74f478db4fd41b64ce8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:06.859309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.859943 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d6650976-de6c-45f9-a009-4d4cb6fd1050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:06.861513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1345/2682] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:06 2022] DELETE /identity/v3/projects/ba1dc2baafa74f478db4fd41b64ce8f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:06.866318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:06.866799 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:06.866898 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:06.887362 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:06.888590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:06.947181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1338/2683] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:06.956435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:06.956758 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:06.957041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:06.976366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:06.977587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:06.985623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1346/2684] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:06.989780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:06.999741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2788e-0c95-4160-aefb-8b51ea466009 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.004522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.005110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.005387 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.005652 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.006283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:11:07.006579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.008148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.020121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1339/2685] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:11:07.024357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.034294 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582dc67-d6cb-4cf4-a9d6-45708543caa2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.038846 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.039428 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.039705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.039971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.040615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.042482 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.071258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1347/2686] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:07.075512 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.086684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730b9cf-f741-48e2-a163-01357d6e14c8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.142089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.142690 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.142970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.143240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.143859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.145780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.166015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1340/2687] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:07.170116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.181229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48667215-5e7b-4f72-9cb4-d970902f7d82 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.186242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.186889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.187831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.188100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.188849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.190445 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.200346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1348/2688] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:11:07.204935 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.214643 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ee6f-67b7-4861-a5bf-32c40f89ddfe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.219731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.220352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.220663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.220937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.221601 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.223179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d69747-930c-45a9-b055-f6a110a9137e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.234238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1341/2689] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:07.238625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.248582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70562dae-2440-4301-b353-8bdd43fa02af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.254158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.254794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.255070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.255346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] PATH_INFO: `/v3/projects/c6f469b8dd98470a97d28e4d99527e81/users/d3ec4b09876147218e6fb6d56e0d2727/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.270176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f469b8dd98470a97d28e4d99527e81, user_id=d3ec4b09876147218e6fb6d56e0d2727, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.272841 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.286331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1349/2690] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:07 2022] PUT /identity/v3/projects/c6f469b8dd98470a97d28e4d99527e81/users/d3ec4b09876147218e6fb6d56e0d2727/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:07.298273 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.298577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.298850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.325618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] MFA Rules not processed for user `d3ec4b09876147218e6fb6d56e0d2727`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:07.326744 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:07.332618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:07.392003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1342/2691] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:07.396563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.458083 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069dfe-f2e1-4ef3-831a-220ef08f3201 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.463578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.464807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.465144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.465422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.466115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.468023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.494590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1350/2692] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:07.498669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.509814 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a372-8c4f-48fb-b5d4-2e24c308495c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.565347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.566180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.566461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.566730 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.567352 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.569318 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.590287 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1343/2693] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:07.594336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.605181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da6e-d60f-4a2e-95b8-e62d0b770207 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.609745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.610968 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.611351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.611626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.612270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.613912 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.624210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1351/2694] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:07.628448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.638474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517e4fd-3d1e-4f79-913d-a126ff45ce62 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.643286 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.643929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.644208 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.644500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] PATH_INFO: `/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf/users/61b9a31e394e45828b9154dc2d9a16d9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.659931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2388ef7813ed410b89fbe04fbdf5c8bf, user_id=61b9a31e394e45828b9154dc2d9a16d9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.662625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.675923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1344/2695] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:07 2022] PUT /identity/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf/users/61b9a31e394e45828b9154dc2d9a16d9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:07.679872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.690066 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2adb1-6885-435a-a6ae-ace155bb2fdb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.729370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:07.748328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.748952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.749233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.749503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.750134 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.751839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b219541-d938-4ab4-8e01-124cc236fb35 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.761456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1352/2696] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:07.765660 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.776555 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc1ae2-045e-4e39-9854-05bc4b980424 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.781612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.783262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.783536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.783812 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] PATH_INFO: `/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf/users/61b9a31e394e45828b9154dc2d9a16d9/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.785780 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2388ef7813ed410b89fbe04fbdf5c8bf, user_id=61b9a31e394e45828b9154dc2d9a16d9, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.788412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.798703 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1345/2697] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:07 2022] PUT /identity/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf/users/61b9a31e394e45828b9154dc2d9a16d9/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:07.809984 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.810446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.810565 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.838323 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] MFA Rules not processed for user `61b9a31e394e45828b9154dc2d9a16d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:07.839546 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:07.905387 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1353/2698] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:07.917045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:07.918759 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:07.975615 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf76c43-c0e1-46dd-a83c-42a58febe4fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:07.979246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:07.979842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:07.980121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:07.980392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:07.989392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:07.990811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafe483-0eea-4082-b72c-2975aa1c00b2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:07.999999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1346/2699] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:11:08.570087 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:08.631983 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e606-d340-4211-93be-3d43ee49742f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:08.636573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:08.637195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:08.637474 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:08.637745 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] PATH_INFO: `/v3/users/d3ec4b09876147218e6fb6d56e0d2727` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:08.638854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ec4b09876147218e6fb6d56e0d2727)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:08.640783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:08.688995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ec4b09876147218e6fb6d56e0d2727'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:08.701003 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ec4b09876147218e6fb6d56e0d2727'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:08.702197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:08.710341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ec4b09876147218e6fb6d56e0d2727'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:08.711047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ec4b09876147218e6fb6d56e0d2727'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:08.711659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ec4b09876147218e6fb6d56e0d2727'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:08.724380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1354/2700] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:08 2022] DELETE /identity/v3/users/d3ec4b09876147218e6fb6d56e0d2727 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:08.728891 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:08.729184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:08.729463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:08.737027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:08.749929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:08.751947 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:08.811658 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1347/2701] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:08.822070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:08.823503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:08.902582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28006f4-0509-405d-b363-eb8d5028bded admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:08.906258 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:08.907366 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:08.907692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:08.908092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:08.917076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:08.918481 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:08.928712 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1355/2702] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:11:09.191653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:09.193322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:09.206534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b6cb1-e506-4001-a8c1-f44e0e235706 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:09.211367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:09.212045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:09.212320 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:09.212621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] PATH_INFO: `/v3/projects/c6f469b8dd98470a97d28e4d99527e81` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:09.213722 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f469b8dd98470a97d28e4d99527e81)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:09.215621 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:09.264617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f469b8dd98470a97d28e4d99527e81', 'request_id': 'req-269dd700-bd3a-4144-9d53-46752e21a77b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.270697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f469b8dd98470a97d28e4d99527e81', 'request_id': 'req-269dd700-bd3a-4144-9d53-46752e21a77b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.277916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f469b8dd98470a97d28e4d99527e81', 'request_id': 'req-269dd700-bd3a-4144-9d53-46752e21a77b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.290062 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] The token cache is being invalidate because project c6f469b8dd98470a97d28e4d99527e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:09.290374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.291005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.292576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1348/2703] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:09 2022] DELETE /identity/v3/projects/c6f469b8dd98470a97d28e4d99527e81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:09.296588 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:09.306456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444074c-b1f1-46d2-9203-4f1c5bb0f8e3 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:09.363607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:09.364221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:09.364526 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:09.364803 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] PATH_INFO: `/v3/users/61b9a31e394e45828b9154dc2d9a16d9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:09.365907 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b9a31e394e45828b9154dc2d9a16d9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:09.367801 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:09.413320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b9a31e394e45828b9154dc2d9a16d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.426881 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b9a31e394e45828b9154dc2d9a16d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.428875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:09.435259 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b9a31e394e45828b9154dc2d9a16d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.436035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b9a31e394e45828b9154dc2d9a16d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.437040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64dcab3d-35f1-4d9b-94a7-6ae57986371a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b9a31e394e45828b9154dc2d9a16d9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.449986 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1356/2704] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:09 2022] DELETE /identity/v3/users/61b9a31e394e45828b9154dc2d9a16d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:09.724238 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:09.725791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:09.739723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd700-bd3a-4144-9d53-46752e21a77b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:09.802019 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:09.803230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:09.803521 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:09.803796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] PATH_INFO: `/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:09.805262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2388ef7813ed410b89fbe04fbdf5c8bf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:09.807163 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:09.840963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:09.857023 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2388ef7813ed410b89fbe04fbdf5c8bf', 'request_id': 'req-a05a0ba9-17af-4fc8-992f-22bfd820bf18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.862446 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2388ef7813ed410b89fbe04fbdf5c8bf', 'request_id': 'req-a05a0ba9-17af-4fc8-992f-22bfd820bf18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.869939 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2388ef7813ed410b89fbe04fbdf5c8bf', 'request_id': 'req-a05a0ba9-17af-4fc8-992f-22bfd820bf18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.881467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] The token cache is being invalidate because project 2388ef7813ed410b89fbe04fbdf5c8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:09.881747 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.882370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a05a0ba9-17af-4fc8-992f-22bfd820bf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:09.883824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1349/2705] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:09 2022] DELETE /identity/v3/projects/2388ef7813ed410b89fbe04fbdf5c8bf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:09.888626 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:09.889108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:09.889222 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:09.908733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:09.909903 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:09.971898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1357/2706] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:09.979448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:09.979731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:09.980031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:09.999389 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:10.001136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:10.009171 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1350/2707] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:10.013484 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.024042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a23fd-56cd-4224-9fdf-e7d940c2dfb7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.028508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.029109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.029382 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.029653 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.030291 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:11:10.030585 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.032299 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.043614 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1358/2708] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:11:10.048574 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.057612 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ebe55-4596-4d99-b379-85fd3eef219c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.062144 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.062726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.063000 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.063959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.064721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.066587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.092837 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1351/2709] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:10.097031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.106819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae104e8e-ec89-4a8b-89c6-f6ed0a7e97f3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.162304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.162898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.163177 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.163453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.164067 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.165971 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.186899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1359/2710] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:10.192361 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.204670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3615aa7-fbc5-4552-80d9-561234327608 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.209775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.210454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.210694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.210967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.211617 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.213274 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.224003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1352/2711] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:10.228082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.238627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafcc6c-90cd-444e-93e3-b438a4d8aeed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.243307 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.243894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.244172 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.244440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.245123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.246684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d9f70-7cf1-4af3-9ecf-20d205509605 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.257827 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1360/2712] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:10.261873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.271835 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cdb08-d75c-4969-bb1c-72da2253be16 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.276622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.277265 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.277548 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.277824 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] PATH_INFO: `/v3/projects/9b1da28bd4c74d989c1c30d6d477f385/users/11ceb533a1f04cbf8faaac317da7ee31/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.292345 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1da28bd4c74d989c1c30d6d477f385, user_id=11ceb533a1f04cbf8faaac317da7ee31, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.295007 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.307888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1353/2713] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:10 2022] PUT /identity/v3/projects/9b1da28bd4c74d989c1c30d6d477f385/users/11ceb533a1f04cbf8faaac317da7ee31/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:10.319919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.320204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.320500 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.348158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] MFA Rules not processed for user `11ceb533a1f04cbf8faaac317da7ee31`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:10.349402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:10.388757 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:10.414625 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1361/2714] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:10.419342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.482310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c5cbe-7d6c-4c84-8de6-c8da0240d4d8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.488151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.488888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.489169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.489438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.490067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.492024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.527520 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1354/2715] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:10.531529 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.542979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7124f07-9256-42b2-a668-b32575c812f7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.599883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.600508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.600791 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.601063 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.601689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.603578 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.624793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1362/2716] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:10.628916 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.639102 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f75f1-adbd-4b69-a169-80540ca89cda admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.643748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.644340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.644654 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.644931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.645592 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.647202 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.658063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1355/2717] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:10.662143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.672072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e46bd-f644-4fc4-a96e-9c0d25682482 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.677636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.678284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.678698 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.678980 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] PATH_INFO: `/v3/projects/f7a3779ec3d04236954257464a5eee98/users/46ed416644a84b0f91d7d94e9a74c664/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.693913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a3779ec3d04236954257464a5eee98, user_id=46ed416644a84b0f91d7d94e9a74c664, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.696610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.709537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1363/2718] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:10 2022] PUT /identity/v3/projects/f7a3779ec3d04236954257464a5eee98/users/46ed416644a84b0f91d7d94e9a74c664/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:11:10.713531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.723925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fc47b-b1dd-4e8e-b325-f141311cc650 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.748013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:10.782965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.783566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.783847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.784121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.784797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.786397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20629eb0-b0e5-481d-88bb-46993c9d348e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.796324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1356/2719] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:11:10.800856 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.811245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296b48f-de69-4379-b419-5b87289810f4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:10.815894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:10.816571 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.816854 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.817126 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] PATH_INFO: `/v3/projects/f7a3779ec3d04236954257464a5eee98/users/46ed416644a84b0f91d7d94e9a74c664/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.819106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a3779ec3d04236954257464a5eee98, user_id=46ed416644a84b0f91d7d94e9a74c664, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:10.821742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:10.832852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1364/2720] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:10 2022] PUT /identity/v3/projects/f7a3779ec3d04236954257464a5eee98/users/46ed416644a84b0f91d7d94e9a74c664/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:11:10.843035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:10.843323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:10.843600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:10.871259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] MFA Rules not processed for user `46ed416644a84b0f91d7d94e9a74c664`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:10.872454 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:10.939871 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1357/2721] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:10.951544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:10.953242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:11.010232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318192f-16bc-40b7-921a-475a1b07eb48 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:11.013795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:11.014381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:11.014654 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:11.014920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:11.025364 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:11.026817 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:11.037317 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1365/2722] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:11.114236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:11.123745 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f2a8-d62c-405c-8ded-1424f031b563 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:11.127677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:11.128281 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:11.128596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:11.128875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:11.186143 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:11.187635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b337f-e01f-4a7f-83de-28acadea4f2e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:11.196901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1358/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:11.458749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:11.497456 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:11.522739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e4398-c882-4f89-86e7-729b7d7cda39 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:11.527214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:11.527831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:11.528111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:11.528386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] PATH_INFO: `/v3/users/11ceb533a1f04cbf8faaac317da7ee31` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:11.529530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ceb533a1f04cbf8faaac317da7ee31)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:11.531423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:11.577502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ceb533a1f04cbf8faaac317da7ee31'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:11.589435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ceb533a1f04cbf8faaac317da7ee31'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:11.597381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ceb533a1f04cbf8faaac317da7ee31'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:11.598175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ceb533a1f04cbf8faaac317da7ee31'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:11.598795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ceb533a1f04cbf8faaac317da7ee31'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:11.612507 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1366/2724] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:11 2022] DELETE /identity/v3/users/11ceb533a1f04cbf8faaac317da7ee31 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:11.617071 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:11.617355 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:11.617626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:11.639322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:11.640536 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:11.681888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:11.700811 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1359/2725] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:11.710831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:11.712213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:11.769806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2b4e6-4642-400e-b17c-79be3d640a47 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:11.773668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:11.774193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:11.774466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:11.774732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:11.784248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:11.785694 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:11.794954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1367/2726] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:12.073715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.075207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:12.088923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8234db7-9cc3-4cb9-9ecf-b395cee73343 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:12.093825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:12.094477 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.094944 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.095340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] PATH_INFO: `/v3/projects/9b1da28bd4c74d989c1c30d6d477f385` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.096511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1da28bd4c74d989c1c30d6d477f385)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:12.098476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:12.144410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1da28bd4c74d989c1c30d6d477f385', 'request_id': 'req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.149848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1da28bd4c74d989c1c30d6d477f385', 'request_id': 'req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.156958 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1da28bd4c74d989c1c30d6d477f385', 'request_id': 'req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.167873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] The token cache is being invalidate because project 9b1da28bd4c74d989c1c30d6d477f385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:12.168156 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.168797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.170244 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1360/2727] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:12 2022] DELETE /identity/v3/projects/9b1da28bd4c74d989c1c30d6d477f385 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:12.174389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.183925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd7788-65c9-4465-b4a5-0ae2ef906b11 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:12.233657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:12.240225 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:12.240877 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.241476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.241808 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] PATH_INFO: `/v3/users/46ed416644a84b0f91d7d94e9a74c664` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.242932 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ed416644a84b0f91d7d94e9a74c664)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:12.245311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:12.289870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ed416644a84b0f91d7d94e9a74c664'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.302293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ed416644a84b0f91d7d94e9a74c664'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.308953 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ed416644a84b0f91d7d94e9a74c664'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.309615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ed416644a84b0f91d7d94e9a74c664'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.310220 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a26ab7-7e05-4bf8-a8d4-5c0cc5bb257a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ed416644a84b0f91d7d94e9a74c664'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.323778 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1368/2728] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:12 2022] DELETE /identity/v3/users/46ed416644a84b0f91d7d94e9a74c664 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:11:12.589284 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.591169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:12.604825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac36bae-bd39-47e2-ab0e-9dbcb40ab2fa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:12.662507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:12.663149 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.663427 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.663699 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] PATH_INFO: `/v3/projects/f7a3779ec3d04236954257464a5eee98` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.664847 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a3779ec3d04236954257464a5eee98)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:12.666746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:12.713131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a3779ec3d04236954257464a5eee98', 'request_id': 'req-345cbe9d-11d3-4c2e-86d2-0a0af914de58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.718750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a3779ec3d04236954257464a5eee98', 'request_id': 'req-345cbe9d-11d3-4c2e-86d2-0a0af914de58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.726796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a3779ec3d04236954257464a5eee98', 'request_id': 'req-345cbe9d-11d3-4c2e-86d2-0a0af914de58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.734711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:12.739368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] The token cache is being invalidate because project f7a3779ec3d04236954257464a5eee98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:12.739816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.741070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-345cbe9d-11d3-4c2e-86d2-0a0af914de58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:12.742681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1361/2729] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:12 2022] DELETE /identity/v3/projects/f7a3779ec3d04236954257464a5eee98 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:11:12.747855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.748141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.748414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.768773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:12.769985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:12.828178 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1369/2730] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:12.837922 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.838138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.838412 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.859468 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:12.860929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:12.868927 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1362/2731] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:12.873154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.883797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb78e0-7b44-4064-997b-abe1b5321c93 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:12.888346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:12.888964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.889239 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.889505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.890148 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:11:12.890450 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:12.892761 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:12.903964 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1370/2732] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:11:12.908443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.917557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057789-ac7c-429b-8bc1-05b1a2ed5ce2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:12.922083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:12.922902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:12.923247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:12.923517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:12.924130 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:12.926046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:12.952874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1363/2733] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:12 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:12.957956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:12.968014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8302f4-0f8f-46f4-9ad2-bff7d9228785 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:13.022894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:13.023483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.023760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.024029 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.024684 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:13.026607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:13.036125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:13.049524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1371/2734] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:12 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:13.053583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:13.064334 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d86efb-0a70-45bf-9efa-2eac58f082de admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:13.069036 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:13.069625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.069902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.070170 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.070803 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:13.072391 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:13.082341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1364/2735] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:13.086053 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:13.096525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e37e8-d935-4ffd-8aa7-0c6ef2eb95ab admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:13.101096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:13.101678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.101954 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.102224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.102859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:13.104416 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c42a00-9022-4d09-bb4d-3e5d3b976fa8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:13.115781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1372/2736] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:13.119893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:13.130386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48621e-98cf-4520-8ad8-04ba15b9220e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:13.135044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:13.135686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.135962 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.136230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] PATH_INFO: `/v3/projects/1bb99d8d82de4322adde7d4d758bfd40/users/7586a9b149294be9b8ebe443e2c02130/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.150462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb99d8d82de4322adde7d4d758bfd40, user_id=7586a9b149294be9b8ebe443e2c02130, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:13.153109 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:13.165195 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1365/2737] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:13 2022] PUT /identity/v3/projects/1bb99d8d82de4322adde7d4d758bfd40/users/7586a9b149294be9b8ebe443e2c02130/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:13.176388 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.176892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.177017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.205000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] MFA Rules not processed for user `7586a9b149294be9b8ebe443e2c02130`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:13.206200 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:13.268942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1373/2738] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:13.279509 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:13.281189 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:13.337373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d282a-f827-4c1e-9e45-53538c65b549 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:13.340953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:13.341554 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:13.341829 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:13.342095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:13.350342 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:13.351697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee416475-b383-4a1d-b05c-e62527eb7be7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:13.360907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1366/2739] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:18.680770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:18.741743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c85cb-ab9b-42ee-a215-269cd3a05355 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:18.746179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:18.746799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:18.747076 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:18.747343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] PATH_INFO: `/v3/users/7586a9b149294be9b8ebe443e2c02130` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:18.748438 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7586a9b149294be9b8ebe443e2c02130)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:18.750415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:18.795863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7586a9b149294be9b8ebe443e2c02130'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:18.808376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7586a9b149294be9b8ebe443e2c02130'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:18.815458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7586a9b149294be9b8ebe443e2c02130'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:18.816138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7586a9b149294be9b8ebe443e2c02130'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:18.816770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7586a9b149294be9b8ebe443e2c02130'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:18.818415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:18.831857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1374/2740] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:11:18 2022] DELETE /identity/v3/users/7586a9b149294be9b8ebe443e2c02130 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:18.836299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:18.836793 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:18.836902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:18.855486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:18.856692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:18.913526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1367/2741] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:18.924109 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:18.925649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:18.982107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61d066-c61f-4db9-8cf0-31be6de8ef6b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:18.986303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:18.986897 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:18.987174 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:18.987443 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:18.996173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:18.997721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a99183-1108-418d-8720-e0b74cc220f2 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.007008 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1375/2742] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:19.269118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.270545 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:19.283474 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098b1c5-cec8-4368-854a-d25117d8fe1f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.288064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.288719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.289419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.289419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] PATH_INFO: `/v3/projects/1bb99d8d82de4322adde7d4d758bfd40` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.290411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb99d8d82de4322adde7d4d758bfd40)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.292297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.330408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:19.341546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb99d8d82de4322adde7d4d758bfd40', 'request_id': 'req-2bbad365-12f0-483f-a41a-7d076b47a601'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:19.347539 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb99d8d82de4322adde7d4d758bfd40', 'request_id': 'req-2bbad365-12f0-483f-a41a-7d076b47a601'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:19.354675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb99d8d82de4322adde7d4d758bfd40', 'request_id': 'req-2bbad365-12f0-483f-a41a-7d076b47a601'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:19.365542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] The token cache is being invalidate because project 1bb99d8d82de4322adde7d4d758bfd40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:11:19.365893 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:19.366514 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2bbad365-12f0-483f-a41a-7d076b47a601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:11:19.367971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1368/2743] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:11:19 2022] DELETE /identity/v3/projects/1bb99d8d82de4322adde7d4d758bfd40 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:19.375197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.375459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.375727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.395085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:19.396269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:19.457732 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1376/2744] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:19.465605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.465888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.466205 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.486192 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:19.487364 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:19.495083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1369/2745] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:19.499161 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.509899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0d761-4923-4377-9c07-293a22aea602 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.514368 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.514952 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.515227 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.515495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.517302 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:11:19.517598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.519162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.530905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1377/2746] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:11:19.535232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.544375 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58f6d-823f-471a-9063-05701b0966b5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.549113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.549696 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.549970 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.550236 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.550842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.552746 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.580859 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1370/2747] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:19 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:19.585060 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.595327 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c207a10-1cc8-4c46-a8a1-b5af2e549f5c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.652455 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.653153 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.653435 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.653734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.654351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.656242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.677015 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1378/2748] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:19 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:19.681234 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.692183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d852ce-7ccb-4677-a849-3b43aa392ace admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.696737 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.697330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.697604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.697870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.698502 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.700390 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.712217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1371/2749] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:19.716160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.726168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8066-444d-4b62-ab8a-2025d5b37042 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.730750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.731329 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.731604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.731872 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.732527 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.734092 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71152b8-daa9-4737-be55-152fc5df644c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.739345 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:19.745737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1379/2750] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:19.749971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.760797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43158-670a-4977-99d7-f712dd7e2c85 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.765306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.767147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.767433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.767705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] PATH_INFO: `/v3/projects/a639e90112b44c99856bdb32a58afa19/users/c1d5dfa59f79433a9d5c3d3bdbeafb4d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.782184 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a639e90112b44c99856bdb32a58afa19, user_id=c1d5dfa59f79433a9d5c3d3bdbeafb4d, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.785015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.799269 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1372/2751] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:19 2022] PUT /identity/v3/projects/a639e90112b44c99856bdb32a58afa19/users/c1d5dfa59f79433a9d5c3d3bdbeafb4d/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:19.804788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d914cf-f304-4487-b190-ee53e6e1ddec None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.805100 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d914cf-f304-4487-b190-ee53e6e1ddec None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.805370 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d914cf-f304-4487-b190-ee53e6e1ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.824606 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-83d914cf-f304-4487-b190-ee53e6e1ddec None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:19.825788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-83d914cf-f304-4487-b190-ee53e6e1ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:19.885688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1380/2752] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:11:19.895321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:19.897031 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:19.956749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc91887-b73a-43bf-a805-899e31ec7df6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:19.960508 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:19.961129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:19.961410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:19.961684 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:19.970804 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:19.972168 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:19.981340 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1373/2753] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:24.189731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.190243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.190243 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.220644 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] MFA Rules not processed for user `c1d5dfa59f79433a9d5c3d3bdbeafb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:24.221936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:24.295080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1381/2754] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:24.296465 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.306491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f579-3d4e-4690-9203-82f5442321fb service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.311148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.311748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.312026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.312294 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.312995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.314879 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.347832 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1374/2755] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:11:24 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:11:24.352125 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.364393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7f57d-f043-4ffc-b84a-a39fa110a0ea None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.447582 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.448326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.448641 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.448915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.449593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.451605 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.476857 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1382/2756] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:11:24 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:11:24.480604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.491709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523eb3-4a06-4f83-8177-ed83c5f4711a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.496640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.497264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.497546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.497886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.498712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.500447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.512270 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1375/2757] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:24.517508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.527927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5399e-fe91-4039-abcc-59f4838b265b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.533839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.534513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.534797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.535081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] PATH_INFO: `/v3/projects/08bcd5e4c87245c39ae8a952347f4db0/users/c5d2e64040414aefa8d5a5bd23a9850c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.551463 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bcd5e4c87245c39ae8a952347f4db0, user_id=c5d2e64040414aefa8d5a5bd23a9850c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.554139 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.559213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:24.570895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1383/2758] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:24 2022] PUT /identity/v3/projects/08bcd5e4c87245c39ae8a952347f4db0/users/c5d2e64040414aefa8d5a5bd23a9850c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:24.575035 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.587101 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5652ad3-680d-4d78-aaa4-65238eef18d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.614822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:24.649932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.650560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.650849 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.651126 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.651775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.653448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda429bb-9e00-4dad-b4cf-c41f6e65cadd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.665160 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1376/2759] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:11:24.669260 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:24.679963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cc89b-1dd8-4c00-a5ff-a9c3d03f2e5f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:24.684956 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:24.685731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:24.686113 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:24.686519 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] PATH_INFO: `/v3/projects/08bcd5e4c87245c39ae8a952347f4db0/users/c5d2e64040414aefa8d5a5bd23a9850c/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:24.689232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bcd5e4c87245c39ae8a952347f4db0, user_id=c5d2e64040414aefa8d5a5bd23a9850c, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:24.692017 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:24.702938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1384/2760] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:11:24 2022] PUT /identity/v3/projects/08bcd5e4c87245c39ae8a952347f4db0/users/c5d2e64040414aefa8d5a5bd23a9850c/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:11:28.850562 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab941-2719-4a58-9378-b050d5eda0a4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:28.851124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab941-2719-4a58-9378-b050d5eda0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:28.851124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ab941-2719-4a58-9378-b050d5eda0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:28.879880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fe6ab941-2719-4a58-9378-b050d5eda0a4 None None] MFA Rules not processed for user `c5d2e64040414aefa8d5a5bd23a9850c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:28.881123 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fe6ab941-2719-4a58-9378-b050d5eda0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:28.950432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1377/2761] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:11:28.969434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:28.971886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:29.100689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6878f-48ae-4050-a544-0c38b9dde4c5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:29.106743 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:29.107359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:29.107673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:29.108072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:29.175610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:29.177576 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:29.187386 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1385/2762] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:30.282860 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f6177-8453-4913-867d-5971698005f3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:30.283338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f6177-8453-4913-867d-5971698005f3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:30.283553 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f6177-8453-4913-867d-5971698005f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:30.303673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a03f6177-8453-4913-867d-5971698005f3 None None] MFA Rules not processed for user `c1d5dfa59f79433a9d5c3d3bdbeafb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:30.304923 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a03f6177-8453-4913-867d-5971698005f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:30.312158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1378/2763] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:11:38.788325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:38.789739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:38.851940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:38.895262 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb471-099d-48ab-be43-e2a3f12605d3 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:38.900615 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:38.901223 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:38.901498 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:38.901771 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:38.903490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:38.916497 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:38.918144 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:38.928892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1386/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:40.297842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=53 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:48.924446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=17 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:11:49.920081 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030313d6-7d93-4a0c-b811-a0ee9337e3ce None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:49.920618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030313d6-7d93-4a0c-b811-a0ee9337e3ce None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:49.920748 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030313d6-7d93-4a0c-b811-a0ee9337e3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:49.940419 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-030313d6-7d93-4a0c-b811-a0ee9337e3ce None None] MFA Rules not processed for user `dad205cc78f8493196ff5856fbe9d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:11:49.941692 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-030313d6-7d93-4a0c-b811-a0ee9337e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:11:49.998506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1379/2765] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:11:56.458645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:11:56.517197 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db9a26-9cde-4026-9861-efe28e21fdec service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:11:56.521242 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:11:56.521850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:11:56.522165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:11:56.522434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:11:56.532337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:11:56.533798 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:11:56.543892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1387/2766] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:11:59.991698 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=25 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:06.539858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=26 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:12:50.753467 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:12:50.754012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:12:50.754012 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:12:50.773819 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] MFA Rules not processed for user `dad205cc78f8493196ff5856fbe9d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:12:50.774992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:12:50.781702 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1380/2767] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:12:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:12:52.536446 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:12:52.547248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a42b2-5745-47fd-9f17-50e3f48f04d6 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:12:52.552021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:12:52.552734 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:12:52.553082 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:12:52.553419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:12:52.555218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:12:52.570419 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:12:52.571985 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:12:52.585575 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1388/2768] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:12:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:12:57.505905 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:12:57.507363 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:12:57.519251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae014211-5bb2-433b-b698-24982a29c6c0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:12:57.522848 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:12:57.523452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:12:57.523733 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:12:57.524015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:12:57.525779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:12:57.540140 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:12:57.541625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:12:57.553455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1381/2769] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:13:02.580471 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:07.547674 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=9 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:50.216093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:50.217649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:50.232813 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3fb44-c15e-42c4-a41c-d775390d2f6f service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:50.239104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:50.239818 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:50.240567 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:50.241005 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:50.243556 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:50.258970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:50.260600 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:50.274043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1389/2770] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:13:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:13:58.434762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:58.446844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81309ce5-5b06-4bc2-9cfe-ed8ecccb1dfa service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:58.451779 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:58.452380 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:58.452680 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:58.452952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:58.454937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:58.467886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:58.469497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:58.480653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1382/2771] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:13:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:13:58.503269 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:58.504920 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:58.571728 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65a4a-1ef2-4b94-9d10-e77b69b084d3 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:58.576425 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:58.577081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:58.577357 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:58.577631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] PATH_INFO: `/v3/users/dad205cc78f8493196ff5856fbe9d3d1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:58.578746 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad205cc78f8493196ff5856fbe9d3d1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:58.580938 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:58.627355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad205cc78f8493196ff5856fbe9d3d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.638927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad205cc78f8493196ff5856fbe9d3d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.646707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad205cc78f8493196ff5856fbe9d3d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.647389 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad205cc78f8493196ff5856fbe9d3d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.647997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d501f276-9c5f-4c08-a572-4db91d411692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad205cc78f8493196ff5856fbe9d3d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.661288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1390/2772] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:13:58 2022] DELETE /identity/v3/users/dad205cc78f8493196ff5856fbe9d3d1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:13:58.840423 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:58.855907 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091a3f-9c40-4ce4-bac9-3b289e94fd5e service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:58.921185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:58.921910 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:58.922087 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:58.922500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] PATH_INFO: `/v3/projects/6924e29077f94a408051c3e0d98f49a7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:58.923530 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6924e29077f94a408051c3e0d98f49a7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:58.925490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:58.970881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6924e29077f94a408051c3e0d98f49a7', 'request_id': 'req-18cab842-bad5-4a19-a6fe-7b3d27a373dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.976776 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6924e29077f94a408051c3e0d98f49a7', 'request_id': 'req-18cab842-bad5-4a19-a6fe-7b3d27a373dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.983950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6924e29077f94a408051c3e0d98f49a7', 'request_id': 'req-18cab842-bad5-4a19-a6fe-7b3d27a373dd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.995775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] The token cache is being invalidate because project 6924e29077f94a408051c3e0d98f49a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:13:58.996114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.996723 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-18cab842-bad5-4a19-a6fe-7b3d27a373dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:13:58.998211 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1383/2773] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:13:58 2022] DELETE /identity/v3/projects/6924e29077f94a408051c3e0d98f49a7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:13:59.003224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.003509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.004108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.023176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:13:59.024376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:59.083244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1391/2774] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:13:59.091041 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.091324 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.091595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.111469 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:13:59.112686 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:59.121449 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1384/2775] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:13:59.125799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.136315 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8021280-39ff-4c98-a25c-a58e36263eaa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.140880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.141475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.141751 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.142023 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.142674 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:13:59.142972 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.145381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.146890 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:59.158331 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1392/2776] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:13:59.162732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.172693 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9531b2e-90ba-4075-9baa-d6aa4b0fa11f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.177443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.178042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.178317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.178581 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.179193 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.181110 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.219185 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1385/2777] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:13:59 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:13:59.224207 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.234926 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8ece3-0519-49b5-833a-43c4346f454c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.291094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.291611 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.291888 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.292154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.292794 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.294678 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.316013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1393/2778] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:13:59 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:13:59.320999 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.331558 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19646e0-a612-4041-9330-3ee93cf3a78e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.336280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.336918 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.337217 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.337484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.338120 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.339726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.349648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1386/2779] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:13:59.353534 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.364026 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18c1c3-0ac3-403c-8f3d-08af6fedd161 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.368651 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.369232 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.369509 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.369776 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.370505 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.372182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7282c-6391-4085-931e-9b01f1dcecd6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.383406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1394/2780] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:13:59.387404 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.397240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ea80-188c-437c-a984-1c0d6377280e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.402067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.402707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.402987 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.403258 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] PATH_INFO: `/v3/projects/b41811fe511d4cec87e547d37a421097/users/4cc9529a3632459d801fb5432f6a6be9/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.417672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41811fe511d4cec87e547d37a421097, user_id=4cc9529a3632459d801fb5432f6a6be9, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.420283 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.434969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1387/2781] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:13:59 2022] PUT /identity/v3/projects/b41811fe511d4cec87e547d37a421097/users/4cc9529a3632459d801fb5432f6a6be9/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:13:59.446819 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.447103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.447378 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.476181 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] MFA Rules not processed for user `4cc9529a3632459d801fb5432f6a6be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:13:59.477409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:59.542319 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1395/2782] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:13:59.553841 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:13:59.555584 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:13:59.562038 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:13:59.630481 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c15c7-8baa-40b8-99ee-4269e6aa3b82 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:13:59.636046 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:13:59.636685 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:13:59.636964 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:13:59.637233 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:13:59.645322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:13:59.646884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c49b-c296-4ac1-b3bf-b2e72fa27361 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:13:59.655717 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1388/2783] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:13:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:04.888086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:04.948351 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be5e69-aca1-4492-bb17-7c34178fc4ed None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:04.952748 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:04.953373 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:04.953642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:04.953908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] PATH_INFO: `/v3/users/4cc9529a3632459d801fb5432f6a6be9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:04.955267 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc9529a3632459d801fb5432f6a6be9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:04.958292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:04.960537 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:05.003311 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc9529a3632459d801fb5432f6a6be9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.015659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc9529a3632459d801fb5432f6a6be9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.023346 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc9529a3632459d801fb5432f6a6be9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.024021 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc9529a3632459d801fb5432f6a6be9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.024660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc9529a3632459d801fb5432f6a6be9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.037979 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1396/2784] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:04 2022] DELETE /identity/v3/users/4cc9529a3632459d801fb5432f6a6be9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:05.042472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.042951 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.043069 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.061293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:05.062472 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.121618 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1389/2785] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:05.132216 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.133645 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.189692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138908e-c0ac-4edc-863e-6e1b50df830f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.194147 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.194737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.195014 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.195285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.204548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.205892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.215858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1397/2786] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:05.487247 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.489462 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.502004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea767f9e-58fa-4714-88ba-507c4c45ae16 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.504453 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.506000 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.507791 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.508433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.508750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.509043 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] PATH_INFO: `/v3/projects/b41811fe511d4cec87e547d37a421097` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.510174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41811fe511d4cec87e547d37a421097)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.512089 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.517843 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ec1ff-b152-4caa-97e3-b335252b860a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.522792 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.523376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.523598 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.523858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.525944 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.537423 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.538852 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e0f7-a338-43af-8e94-8a49b936c610 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.547909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1398/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:05.566008 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41811fe511d4cec87e547d37a421097', 'request_id': 'req-43a3e9b3-79e8-4457-98f4-5df1f93331e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.571786 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41811fe511d4cec87e547d37a421097', 'request_id': 'req-43a3e9b3-79e8-4457-98f4-5df1f93331e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.579678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41811fe511d4cec87e547d37a421097', 'request_id': 'req-43a3e9b3-79e8-4457-98f4-5df1f93331e9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.596769 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] The token cache is being invalidate because project b41811fe511d4cec87e547d37a421097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:05.597055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.598370 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-43a3e9b3-79e8-4457-98f4-5df1f93331e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:05.599884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1390/2788] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:05 2022] DELETE /identity/v3/projects/b41811fe511d4cec87e547d37a421097 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:05.604997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.605284 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.605561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.625518 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:05.626707 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.710086 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1399/2789] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:05.713830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.714115 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.714396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.734597 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:05.735707 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:05.744216 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1391/2790] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:05.748620 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.759354 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719179c9-a0cd-4253-a097-d33dd30440ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.764395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.765046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.765328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.765599 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.766247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:14:05.766551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.768141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.777326 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:05.787123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1400/2791] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:14:05.788598 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.797903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa9d45-a19a-420b-8dbc-2616bfe27483 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.803161 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.803762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.804039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.804308 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.804961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.806839 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.811368 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:05.837271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1392/2792] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:05 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:05.842796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.863019 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d559-947d-4919-8806-63cc31a06dd0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.925574 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.926493 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.926777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.927052 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.927689 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.930241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.955859 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1401/2793] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:05 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:14:05.960351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:05.970877 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31defe-a4b7-476d-bb40-a2952f1cb68f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:05.977486 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:05.978090 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:05.978366 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:05.979070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:05.979312 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:05.980945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:05.993347 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1393/2794] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:05.997397 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:06.009563 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b4ff2-a299-4466-b08b-76a89ce872fb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:06.016796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:06.017381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.017659 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.018011 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.018700 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:06.020962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11a7de-3cb5-4830-bb29-1291721eec33 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:06.036123 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1402/2795] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:14:06.037325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:06.047166 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705fb56-2450-4cea-9383-fcafaaf3b12b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:06.052357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:06.053044 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.053326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.053602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] PATH_INFO: `/v3/projects/2b4949e438da44bea894ab4e5dcdc380/users/205c9b379c3b488b8a2558b6fcb4b5e9/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.069969 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4949e438da44bea894ab4e5dcdc380, user_id=205c9b379c3b488b8a2558b6fcb4b5e9, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:06.072874 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:06.086940 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1394/2796] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:06 2022] PUT /identity/v3/projects/2b4949e438da44bea894ab4e5dcdc380/users/205c9b379c3b488b8a2558b6fcb4b5e9/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:06.097285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.097633 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.098090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.127770 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] MFA Rules not processed for user `205c9b379c3b488b8a2558b6fcb4b5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:06.129867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:06.197536 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1403/2797] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:06.209396 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:06.211094 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:06.284644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dfe2-0977-49b2-b145-39c3adbb4078 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:06.290763 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:06.291365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.291649 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.291926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.299661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:06.301280 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47fb5-9b26-4c9a-8ed2-36cfc81f9a46 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:06.309888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1395/2798] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:06.529742 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:06.591849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdb2b0-8c0f-4869-a0e1-7fb1e78753d8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:06.596193 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:06.596842 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.597121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.597898 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] PATH_INFO: `/v3/users/205c9b379c3b488b8a2558b6fcb4b5e9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.599102 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205c9b379c3b488b8a2558b6fcb4b5e9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:06.601025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:06.606229 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:06.647214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205c9b379c3b488b8a2558b6fcb4b5e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:06.659236 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205c9b379c3b488b8a2558b6fcb4b5e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:06.666617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205c9b379c3b488b8a2558b6fcb4b5e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:06.667309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205c9b379c3b488b8a2558b6fcb4b5e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:06.667910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205c9b379c3b488b8a2558b6fcb4b5e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:06.680300 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1404/2799] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:06 2022] DELETE /identity/v3/users/205c9b379c3b488b8a2558b6fcb4b5e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:06.684895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.685271 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.685626 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.704475 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:06.705679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:06.762504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1396/2800] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:06.772823 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:06.774209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:06.833558 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3f4b-23af-407f-8c6e-bdb8a611b601 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:06.837247 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:06.837836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:06.838110 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:06.838376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:06.847176 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:06.849108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5869a4-0b5e-4983-b6e7-1231c2bdc5a8 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:06.858321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1405/2801] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:07.129613 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.131078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:07.143172 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905cf0-4230-4f62-a51a-be8849584b10 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.150194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.150976 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.151105 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.151367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] PATH_INFO: `/v3/projects/2b4949e438da44bea894ab4e5dcdc380` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.152523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4949e438da44bea894ab4e5dcdc380)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.154432 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.190351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:07.205929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4949e438da44bea894ab4e5dcdc380', 'request_id': 'req-f1612624-3978-4531-b768-94c0b9ec0e98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:07.212850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4949e438da44bea894ab4e5dcdc380', 'request_id': 'req-f1612624-3978-4531-b768-94c0b9ec0e98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:07.221589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4949e438da44bea894ab4e5dcdc380', 'request_id': 'req-f1612624-3978-4531-b768-94c0b9ec0e98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:07.233726 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] The token cache is being invalidate because project 2b4949e438da44bea894ab4e5dcdc380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:07.234016 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:07.234662 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f1612624-3978-4531-b768-94c0b9ec0e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:07.236180 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1397/2802] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:07 2022] DELETE /identity/v3/projects/2b4949e438da44bea894ab4e5dcdc380 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:07.241849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcacd-5423-492f-8035-81e899120580 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.242337 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcacd-5423-492f-8035-81e899120580 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.242460 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bcacd-5423-492f-8035-81e899120580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.262727 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b15bcacd-5423-492f-8035-81e899120580 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:07.263906 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b15bcacd-5423-492f-8035-81e899120580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:07.328057 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1406/2803] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:07.337321 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.337606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.337883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.358070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:07.359226 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:07.369063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1398/2804] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:07.373380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcacd-5423-492f-8035-81e899120580 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.383765 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bcacd-5423-492f-8035-81e899120580 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.388334 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.388966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.389245 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.389516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.390154 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:14:07.390589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.392112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.404151 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1407/2805] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:14:07.408374 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.417796 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b0bcb-8ea7-458f-ba8e-7e447ddf9ee6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.422463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.423047 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.423322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.423589 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.424194 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.426092 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.453625 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1399/2806] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:07.458768 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.469031 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3af53-1efd-4691-a47d-43386b17f796 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.481215 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:07.530577 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.531180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.531458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.531730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.532359 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.534306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.555769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1408/2807] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:14:07.559872 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.570165 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98ffe-715e-44aa-aa20-c00507eb2d0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.574880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.575471 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.575842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.576117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.576831 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.578825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.589725 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1400/2808] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:07.593666 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.604074 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054638b8-cbc7-4d59-9f35-9afb9bf98457 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.608812 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.609341 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.609621 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.609893 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.610533 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.612115 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1885f6f-00b8-4b49-a08b-12cd45249948 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.622638 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1409/2809] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:07.626822 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.637091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f670502-74a8-4684-8fbb-16c07c6a118e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.641669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.642303 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.642578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.642844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] PATH_INFO: `/v3/projects/f3be1d20011049b1aab91b22295ad935/users/6173c256a9d24285b54ee3c9bf32fb28/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.658653 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3be1d20011049b1aab91b22295ad935, user_id=6173c256a9d24285b54ee3c9bf32fb28, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.661997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.676992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1401/2810] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:07 2022] PUT /identity/v3/projects/f3be1d20011049b1aab91b22295ad935/users/6173c256a9d24285b54ee3c9bf32fb28/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:07.689773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.690056 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.690328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.717767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] MFA Rules not processed for user `6173c256a9d24285b54ee3c9bf32fb28`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:07.718945 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:07.781981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1410/2811] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:07.786863 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.849890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8359f8-91ad-431a-ab33-b9a8a1855c0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.854721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.855322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.855602 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.855875 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.856566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.858448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.896257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1402/2812] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:07.901094 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:07.912825 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c21a3-40aa-404d-be20-5d8453c1ba5a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:07.969136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:07.969733 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:07.970013 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:07.970285 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:07.970965 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:07.972894 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:07.999462 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1411/2813] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:07 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:14:08.000682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.012640 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ea489-4180-411d-a497-c4d2a192e25c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.018813 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.020336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.020885 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.021298 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.022055 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.024020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.037410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1403/2814] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:08.041530 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.051503 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398a41a-7b7b-4f9a-80c3-8fd7d81ddea8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.057434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.058343 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.058786 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.059090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] PATH_INFO: `/v3/projects/6c19cf79debc46f290215d1fcabac72b/users/d7ee1715ba4247118366781a9db70442/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.072705 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:08.077362 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c19cf79debc46f290215d1fcabac72b, user_id=d7ee1715ba4247118366781a9db70442, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.082483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.095796 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1412/2815] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:08 2022] PUT /identity/v3/projects/6c19cf79debc46f290215d1fcabac72b/users/d7ee1715ba4247118366781a9db70442/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:08.099986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.110125 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5d498-3659-4fa6-acd2-09ce26e2a06c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.138067 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:08.171299 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.171945 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.172222 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.172507 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.173148 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.174743 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45d31f-1207-43c3-9005-e4d2d8f961b7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.185249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1404/2816] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:14:08.189617 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.202369 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ddc62-9dfa-4c75-ba60-53f398367653 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.209241 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.209936 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.210218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.210485 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] PATH_INFO: `/v3/projects/6c19cf79debc46f290215d1fcabac72b/users/d7ee1715ba4247118366781a9db70442/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.212409 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c19cf79debc46f290215d1fcabac72b, user_id=d7ee1715ba4247118366781a9db70442, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.215099 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.226183 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1413/2817] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:08 2022] PUT /identity/v3/projects/6c19cf79debc46f290215d1fcabac72b/users/d7ee1715ba4247118366781a9db70442/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:08.236351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.236663 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.236937 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.264873 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] MFA Rules not processed for user `d7ee1715ba4247118366781a9db70442`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:08.266064 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.334304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1405/2818] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:08.345739 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.348042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.428777 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88e02a-eabc-444e-8804-dedbe921d02b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.432909 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.433548 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.433826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.434093 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.443657 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.445108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.455047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1414/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:08.545128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.559455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cb28b-ebfb-48f9-be15-9e448d9fbc6c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.564223 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.565282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.565629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.566750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.633091 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.634607 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.643913 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1406/2820] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:08.702721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.706394 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.782639 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3b6c2-3a72-49f1-9012-71d3309e359d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.786729 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.787461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.787782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.800623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.806681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.831091 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:08.834105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:08.850208 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1415/2821] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:08.928517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:08.929867 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.942394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d432e-7e77-4487-848a-bf289ec99af0 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:08.946005 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:08.946599 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:08.946904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:08.947179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:08.948843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:08.994002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:09.019083 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:09.021097 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d5e2-f19d-4d53-bf40-164f8a4c919c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:09.031880 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1407/2822] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:11.468321 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:11.531604 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fe224-cc36-445d-89ad-5b1b11394c31 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:11.536966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:11.537579 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:11.537850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:11.538116 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] PATH_INFO: `/v3/users/6173c256a9d24285b54ee3c9bf32fb28` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:11.539238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6173c256a9d24285b54ee3c9bf32fb28)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:11.541173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:11.543502 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:11.591046 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6173c256a9d24285b54ee3c9bf32fb28'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:11.602736 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6173c256a9d24285b54ee3c9bf32fb28'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:11.609564 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6173c256a9d24285b54ee3c9bf32fb28'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:11.610240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6173c256a9d24285b54ee3c9bf32fb28'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:11.610851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6173c256a9d24285b54ee3c9bf32fb28'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:11.624356 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1416/2823] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:11 2022] DELETE /identity/v3/users/6173c256a9d24285b54ee3c9bf32fb28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:11.629627 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:11.630154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:11.630154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:11.648681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:11.653317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:11.707801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1408/2824] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:14:11.717395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:11.718836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:11.778295 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfca34-4d44-410e-827c-6ab08e202fd4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:11.781997 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:11.782595 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:11.782895 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:11.783164 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:11.792867 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:11.794280 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:11.804793 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1417/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 17:14:12.088431 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:12.089986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:12.103297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fcc27-6a14-484e-ad04-11fe4b85e54c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:12.107919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:12.108577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.108854 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.109199 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] PATH_INFO: `/v3/projects/f3be1d20011049b1aab91b22295ad935` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.110888 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3be1d20011049b1aab91b22295ad935)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:12.121020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:12.169967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3be1d20011049b1aab91b22295ad935', 'request_id': 'req-8c050711-696a-4c3e-95ac-ceb0d0bf058d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.177026 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3be1d20011049b1aab91b22295ad935', 'request_id': 'req-8c050711-696a-4c3e-95ac-ceb0d0bf058d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.184883 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3be1d20011049b1aab91b22295ad935', 'request_id': 'req-8c050711-696a-4c3e-95ac-ceb0d0bf058d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.197045 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] The token cache is being invalidate because project f3be1d20011049b1aab91b22295ad935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:12.197330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.197959 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.199490 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1409/2826] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:12 2022] DELETE /identity/v3/projects/f3be1d20011049b1aab91b22295ad935 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:12.203670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:12.213863 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceab77-50d9-43b6-b076-b3e757f39b25 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:12.273288 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:12.274199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.274199 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.274495 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] PATH_INFO: `/v3/users/d7ee1715ba4247118366781a9db70442` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.275521 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ee1715ba4247118366781a9db70442)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:12.277439 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:12.306961 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:12.329593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ee1715ba4247118366781a9db70442'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.342383 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ee1715ba4247118366781a9db70442'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.350112 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ee1715ba4247118366781a9db70442'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.350821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ee1715ba4247118366781a9db70442'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.351427 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7062828a-8272-4d07-b2f3-4177f6390464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ee1715ba4247118366781a9db70442'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.364454 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1418/2827] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:12 2022] DELETE /identity/v3/users/d7ee1715ba4247118366781a9db70442 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:12.639629 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:12.641894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:12.657373 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050711-696a-4c3e-95ac-ceb0d0bf058d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:12.712523 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:12.719246 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:12.720251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.720670 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.720948 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] PATH_INFO: `/v3/projects/6c19cf79debc46f290215d1fcabac72b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.722955 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c19cf79debc46f290215d1fcabac72b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:12.725316 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:12.770901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c19cf79debc46f290215d1fcabac72b', 'request_id': 'req-78faf6e5-c34a-4075-bfe5-358976b802a0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.776207 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c19cf79debc46f290215d1fcabac72b', 'request_id': 'req-78faf6e5-c34a-4075-bfe5-358976b802a0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.783068 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c19cf79debc46f290215d1fcabac72b', 'request_id': 'req-78faf6e5-c34a-4075-bfe5-358976b802a0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.794489 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] The token cache is being invalidate because project 6c19cf79debc46f290215d1fcabac72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:12.794772 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.795392 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-78faf6e5-c34a-4075-bfe5-358976b802a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:12.796886 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1410/2828] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:12 2022] DELETE /identity/v3/projects/6c19cf79debc46f290215d1fcabac72b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:12.801740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38637c-e896-4df9-aa70-15014652083c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.802218 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38637c-e896-4df9-aa70-15014652083c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.802336 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38637c-e896-4df9-aa70-15014652083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.821781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ff38637c-e896-4df9-aa70-15014652083c None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:12.822962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ff38637c-e896-4df9-aa70-15014652083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:12.880753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1419/2829] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:12.888447 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.888765 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.889037 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.908950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:12.910924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:12.918961 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1411/2830] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:12.923072 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38637c-e896-4df9-aa70-15014652083c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:12.932991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38637c-e896-4df9-aa70-15014652083c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:12.937589 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:12.938209 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.938488 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.938762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.939432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:14:12.939738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:12.941410 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:12.952701 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1420/2831] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 17:14:12.957842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:12.966926 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddfb90-8988-48f0-83fa-75f8cbc3e522 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:12.972030 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:12.973510 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:12.973881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:12.974151 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:12.974758 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:12.976655 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.003022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1412/2832] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:12 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:13.007217 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.017128 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e66d2-1e63-42c9-8838-4503bf5158b9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.072499 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.073090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.073371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.073642 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.074250 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.076132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.097958 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1421/2833] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:13 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:13.102117 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.112636 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70147f-6dec-4b2f-ba58-332356594d24 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.117709 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.118357 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.118635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.118908 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.119577 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.121285 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.131842 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1413/2834] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:13.135797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.146265 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ada7-c41c-4874-b89b-a922c326e862 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.150858 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.151477 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.151773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.152043 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.152714 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.154283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2508d48-47f6-4bdc-83f5-54685c847ff9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.165393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1422/2835] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 17:14:13.169488 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.179484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c271f-9c3a-444d-a0b0-cb997c0d1552 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.184260 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.184942 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.185225 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.185500 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] PATH_INFO: `/v3/projects/4a328442ef1a4cf5aa7f3dd810893e98/users/07f53ed8e82b418a9bd17e6a2c65ba31/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.200567 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a328442ef1a4cf5aa7f3dd810893e98, user_id=07f53ed8e82b418a9bd17e6a2c65ba31, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.203289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.216438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1414/2836] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:13 2022] PUT /identity/v3/projects/4a328442ef1a4cf5aa7f3dd810893e98/users/07f53ed8e82b418a9bd17e6a2c65ba31/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:13.226915 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.227137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.227415 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.246381 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:13.257160 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] MFA Rules not processed for user `07f53ed8e82b418a9bd17e6a2c65ba31`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:13.258711 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:13.322198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1423/2837] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:13.326677 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.387020 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afda5e-67b1-4d35-824d-eedfc2098cc8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.391731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.392335 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.392648 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.392952 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.393604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.396136 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.422705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1415/2838] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:13 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 17:14:13.427133 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.438292 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f7cd-7aeb-4f44-9bf7-35e4fe1213de None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.499212 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.499750 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.500035 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.500310 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.501007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.502910 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.529120 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1424/2839] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:13 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:13.530325 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.541264 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e8964-5e33-4b1d-8eda-436ac30242d9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.547546 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.548169 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.548452 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.548760 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.549414 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.551721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.554150 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:13.565671 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1416/2840] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:13.570580 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.581328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57fa4-63ad-473a-bc99-346e3aae5cdb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.586892 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.587619 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.587957 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.588296 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] PATH_INFO: `/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72/users/f86ca251f83f48c6b84cb1c107e3c0b0/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.606797 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45c2068fa8b48e0b24822e0ef1adc72, user_id=f86ca251f83f48c6b84cb1c107e3c0b0, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.609586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.624132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1425/2841] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:13 2022] PUT /identity/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72/users/f86ca251f83f48c6b84cb1c107e3c0b0/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:13.629326 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.640024 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c007-61d0-4424-a1eb-12529a716ae0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.705098 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.705706 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.705984 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.706255 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.706929 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.708538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44109a92-1cb7-45d5-928f-d4d80bec62ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.718137 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1417/2842] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:13.722303 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.732773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c93fcb-9f3a-4c61-90c3-aebfaf6c64fa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:13.737561 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:13.738767 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.739275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.739275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] PATH_INFO: `/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72/users/f86ca251f83f48c6b84cb1c107e3c0b0/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.741254 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45c2068fa8b48e0b24822e0ef1adc72, user_id=f86ca251f83f48c6b84cb1c107e3c0b0, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:13.743878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:13.755760 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1426/2843] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:13 2022] PUT /identity/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72/users/f86ca251f83f48c6b84cb1c107e3c0b0/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:13.767113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:13.767394 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:13.767665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:13.795476 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] MFA Rules not processed for user `f86ca251f83f48c6b84cb1c107e3c0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:13.796741 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:13.866777 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1418/2844] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:13.935347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:13.940440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:14.002080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21178-b96a-4b52-b56b-a2910b4822b8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:14.006081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:14.006649 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:14.006927 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:14.007198 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:14.013080 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:14.017628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:14.019795 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f80e3-3684-4729-89fd-4c8234f3c782 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:14.030009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1427/2845] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:15.389040 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:15.452595 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1de3-3430-4d1b-9a33-53aebf053ba3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:15.458209 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:15.458830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:15.459104 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:15.459451 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] PATH_INFO: `/v3/users/07f53ed8e82b418a9bd17e6a2c65ba31` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:15.460630 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f53ed8e82b418a9bd17e6a2c65ba31)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:15.462585 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:15.484131 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:15.508768 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f53ed8e82b418a9bd17e6a2c65ba31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:15.516095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f53ed8e82b418a9bd17e6a2c65ba31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:15.516659 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f53ed8e82b418a9bd17e6a2c65ba31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:15.517268 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f53ed8e82b418a9bd17e6a2c65ba31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:15.525078 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f53ed8e82b418a9bd17e6a2c65ba31'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:15.542411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1419/2846] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:15 2022] DELETE /identity/v3/users/07f53ed8e82b418a9bd17e6a2c65ba31 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:15.547042 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:15.547510 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:15.547631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:15.565754 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:15.567437 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:15.627306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1428/2847] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:15.637010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:15.638430 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:15.696797 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508894-13b1-4f40-8cd3-257cf9c41bf8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:15.700575 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:15.701183 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:15.701464 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:15.701764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:15.711114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:15.712587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:15.722853 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1420/2848] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:15.915036 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:15.916676 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.014041 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5707634-459c-4fd4-b98c-6a21383842ac None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.023310 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.024767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.029538 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.030476 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.030908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.031376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.034607 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.038582 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc57a1-a8d3-4b7a-92c1-0faca1fbb367 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.043579 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.044230 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.044542 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.044820 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] PATH_INFO: `/v3/projects/4a328442ef1a4cf5aa7f3dd810893e98` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.046003 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a328442ef1a4cf5aa7f3dd810893e98)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.047936 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.053179 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.054963 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.069681 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1429/2849] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:16.100495 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a328442ef1a4cf5aa7f3dd810893e98', 'request_id': 'req-309636cd-72bc-4a4b-82ae-56d1369552a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.107029 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a328442ef1a4cf5aa7f3dd810893e98', 'request_id': 'req-309636cd-72bc-4a4b-82ae-56d1369552a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.115965 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a328442ef1a4cf5aa7f3dd810893e98', 'request_id': 'req-309636cd-72bc-4a4b-82ae-56d1369552a5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.127605 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] The token cache is being invalidate because project 4a328442ef1a4cf5aa7f3dd810893e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:16.127971 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.129256 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.130843 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1421/2850] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:16 2022] DELETE /identity/v3/projects/4a328442ef1a4cf5aa7f3dd810893e98 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:16.134774 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.146540 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ca46-c774-4dc2-9978-877b11a8430c service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.204007 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.204925 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.205221 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.205490 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] PATH_INFO: `/v3/users/f86ca251f83f48c6b84cb1c107e3c0b0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.206730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86ca251f83f48c6b84cb1c107e3c0b0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.208785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.230324 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:16.255935 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86ca251f83f48c6b84cb1c107e3c0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.267991 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86ca251f83f48c6b84cb1c107e3c0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.274785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86ca251f83f48c6b84cb1c107e3c0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.275480 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86ca251f83f48c6b84cb1c107e3c0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.276106 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e05f250-4a7d-4fb6-8098-0c2d5b72b4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86ca251f83f48c6b84cb1c107e3c0b0'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.289421 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1430/2851] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:16 2022] DELETE /identity/v3/users/f86ca251f83f48c6b84cb1c107e3c0b0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:16.562697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.564181 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.578689 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309636cd-72bc-4a4b-82ae-56d1369552a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.601381 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:16.639993 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.640700 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.640980 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.641253 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] PATH_INFO: `/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.642386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45c2068fa8b48e0b24822e0ef1adc72)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.644894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.690393 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45c2068fa8b48e0b24822e0ef1adc72', 'request_id': 'req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.696108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45c2068fa8b48e0b24822e0ef1adc72', 'request_id': 'req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.703443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45c2068fa8b48e0b24822e0ef1adc72', 'request_id': 'req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.716377 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] The token cache is being invalidate because project a45c2068fa8b48e0b24822e0ef1adc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:16.716695 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.717336 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bcb4dd7-f372-472d-a75e-a39fbbecea3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:16.718827 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1422/2852] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:16 2022] DELETE /identity/v3/projects/a45c2068fa8b48e0b24822e0ef1adc72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:16.725737 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.726206 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.726325 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.745632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:16.746799 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.804593 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1431/2853] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:16.812245 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.812450 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.812762 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.832928 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:16.834129 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:16.842002 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1423/2854] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:16.846105 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.856270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7822f1-2483-47db-96a1-5d9e0193aea3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.860871 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.861458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.861740 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.862010 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.862661 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:14:16.863508 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.865108 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.876441 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1432/2855] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:14:16.881337 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.890492 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b429b-f83b-49bb-b770-eab4122abd59 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.895282 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.895868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.896145 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.896411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.897082 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:16.898954 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:16.929367 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1424/2856] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:16 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:16.930806 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:16.940693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe793404-8267-4c73-a1a1-2aa0e41211ee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:16.997631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:16.998233 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:16.998544 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:16.998814 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:16.999447 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.001406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.023391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1433/2857] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:16 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:17.027610 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.039323 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31abc-36f9-4ff9-b25c-b07ec85e5b00 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.043903 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.044504 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.044795 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.045063 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.045697 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.047279 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.058566 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1425/2858] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:17.062461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.072355 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056f9f3-8546-40ae-abe0-854194246ab3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.077040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.077636 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.077908 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.078180 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.078824 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.080692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c6b84-3d62-4076-bd55-1e74d7d4ff20 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.091248 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1434/2859] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:17.095407 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.106311 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8a542-4624-4494-8685-eb0339ea3408 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.111121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.111902 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.112075 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.112425 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] PATH_INFO: `/v3/projects/b6828acda95e47409aeea31a17a9808f/users/6da4963af1884887b774838a9cd878f6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.127856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6828acda95e47409aeea31a17a9808f, user_id=6da4963af1884887b774838a9cd878f6, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.130569 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.143004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1426/2860] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:17 2022] PUT /identity/v3/projects/b6828acda95e47409aeea31a17a9808f/users/6da4963af1884887b774838a9cd878f6/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:17.153107 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.153395 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.153670 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.162367 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:17.186773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] MFA Rules not processed for user `6da4963af1884887b774838a9cd878f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:17.188081 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:17.252773 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1435/2861] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:17.257766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.310139 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:17.323865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c314ac-c1d9-4733-a63f-dc502302e5b2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.328701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.329306 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.329850 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.330121 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.330775 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.332756 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.358497 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1427/2862] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:17 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:17.362668 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.373905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70716df-1f2e-4179-aafb-529ea80187f7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.429104 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.429775 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.429993 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.430287 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.431009 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.433085 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.455966 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1436/2863] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:17 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:17.460048 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.470461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad23d-51e0-4aa4-8f47-13c565c633ce admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.475176 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.475766 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.476070 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.476338 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.477032 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.478606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.489315 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1428/2864] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:17.493298 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.503025 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73ca18-ca8c-4828-a103-40c002f0ffb8 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.508475 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.509214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.509491 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.509762 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] PATH_INFO: `/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0/users/118ae4bada2a40a6b2bf59af9389c473/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.524889 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=08aa31e1c1db4ac8905b0a89c2d1dda0, user_id=118ae4bada2a40a6b2bf59af9389c473, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.527513 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.540405 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1437/2865] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:17 2022] PUT /identity/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0/users/118ae4bada2a40a6b2bf59af9389c473/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:17.544259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.554322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c4b0-0550-459c-9487-b733b750fac3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.610891 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.611538 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.611688 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.611963 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.612637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.614808 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28175e21-9195-4bae-bd78-0a509eb2e973 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.624830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1429/2866] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:17.629487 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.639591 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb872-2b57-48c7-8e2a-7f7363cb7dab admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.644194 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.644851 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.645131 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.645402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] PATH_INFO: `/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0/users/118ae4bada2a40a6b2bf59af9389c473/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.647306 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=08aa31e1c1db4ac8905b0a89c2d1dda0, user_id=118ae4bada2a40a6b2bf59af9389c473, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.649981 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.661121 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1438/2867] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:17 2022] PUT /identity/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0/users/118ae4bada2a40a6b2bf59af9389c473/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:17.672901 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.673186 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.673455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.701365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] MFA Rules not processed for user `118ae4bada2a40a6b2bf59af9389c473`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:17.702665 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:17.768461 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1430/2868] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:17.779238 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:17.781068 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:17.834166 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:17.840402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25870e2e-d8a8-45e0-b9a2-19e0b289a6af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:17.844263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:17.844886 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:17.845165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:17.845434 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:17.854913 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:17.856320 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7613e-091f-4716-8856-103894f726ab service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:17.866420 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1439/2869] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:18.233300 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:18.279408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:18.295113 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc50fd-3b83-414e-ac7f-26a63b24012c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:18.299635 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:18.300297 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:18.300623 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:18.300894 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] PATH_INFO: `/v3/users/6da4963af1884887b774838a9cd878f6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:18.302022 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da4963af1884887b774838a9cd878f6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:18.303932 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:18.348418 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da4963af1884887b774838a9cd878f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.355463 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da4963af1884887b774838a9cd878f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.356095 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da4963af1884887b774838a9cd878f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.356732 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da4963af1884887b774838a9cd878f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.363881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da4963af1884887b774838a9cd878f6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.380681 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1431/2870] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:18 2022] DELETE /identity/v3/users/6da4963af1884887b774838a9cd878f6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:18.385338 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:18.385624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:18.385900 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:18.405162 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:18.406347 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:18.466273 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1440/2871] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:18.476506 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:18.477996 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:18.539578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3e37-9506-439f-91aa-88d60ca975e5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:18.543881 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:18.544678 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:18.545127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:18.545552 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:18.558010 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:18.559844 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:18.571415 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1432/2872] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:18.847048 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:18.849145 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:18.861380 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51253bb-4ca7-4d1a-ad20-35475f0bec94 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:18.865995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:18.866623 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:18.866896 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:18.867165 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] PATH_INFO: `/v3/projects/b6828acda95e47409aeea31a17a9808f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:18.868301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6828acda95e47409aeea31a17a9808f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:18.870204 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:18.917422 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6828acda95e47409aeea31a17a9808f', 'request_id': 'req-1bc9a1b7-bc09-46d0-932f-1679637e8917'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.923064 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6828acda95e47409aeea31a17a9808f', 'request_id': 'req-1bc9a1b7-bc09-46d0-932f-1679637e8917'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.929459 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6828acda95e47409aeea31a17a9808f', 'request_id': 'req-1bc9a1b7-bc09-46d0-932f-1679637e8917'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.942391 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] The token cache is being invalidate because project b6828acda95e47409aeea31a17a9808f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:18.942680 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.943313 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:18.944831 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1441/2873] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:18 2022] DELETE /identity/v3/projects/b6828acda95e47409aeea31a17a9808f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:18.948825 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:18.959639 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7bf6-6a65-4d4f-b5da-e05a0c7cc102 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.014313 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.014931 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.015218 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.015526 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] PATH_INFO: `/v3/users/118ae4bada2a40a6b2bf59af9389c473` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.016687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=118ae4bada2a40a6b2bf59af9389c473)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.018587 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.028694 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:19.064369 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118ae4bada2a40a6b2bf59af9389c473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.073009 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118ae4bada2a40a6b2bf59af9389c473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.073609 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118ae4bada2a40a6b2bf59af9389c473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.074201 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118ae4bada2a40a6b2bf59af9389c473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.081212 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-69e793dd-7775-4d5d-b494-0aec5e2fa4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118ae4bada2a40a6b2bf59af9389c473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.098371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1433/2874] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:18 2022] DELETE /identity/v3/users/118ae4bada2a40a6b2bf59af9389c473 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:19.375878 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.377376 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:19.390731 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a1b7-bc09-46d0-932f-1679637e8917 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.448586 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.449138 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.449414 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.449683 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] PATH_INFO: `/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.450788 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08aa31e1c1db4ac8905b0a89c2d1dda0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.452693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.469764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:19.501524 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08aa31e1c1db4ac8905b0a89c2d1dda0', 'request_id': 'req-26c12180-8157-431c-9c31-6482453eea83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.507277 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08aa31e1c1db4ac8905b0a89c2d1dda0', 'request_id': 'req-26c12180-8157-431c-9c31-6482453eea83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.513283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08aa31e1c1db4ac8905b0a89c2d1dda0', 'request_id': 'req-26c12180-8157-431c-9c31-6482453eea83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.526090 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] The token cache is being invalidate because project 08aa31e1c1db4ac8905b0a89c2d1dda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:19.526372 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.526992 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-26c12180-8157-431c-9c31-6482453eea83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:19.528501 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1442/2875] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:19 2022] DELETE /identity/v3/projects/08aa31e1c1db4ac8905b0a89c2d1dda0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:19.533421 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.533712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.533988 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.554738 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:19.555919 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:19.616228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1434/2876] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 17:14:19.623940 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.624226 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.624525 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.644672 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:19.645855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:19.653692 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1443/2877] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:19.657925 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.668622 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58653c9-3af0-4779-89ff-3287eba6cb28 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.673127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.673721 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.673995 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.674259 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.674904 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 17:14:19.675749 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.677857 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.689328 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1435/2878] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 10 17:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 17:14:19.694440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.703655 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479685b-f02a-4155-ac4e-6b5c827cab02 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.709111 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.709693 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.709970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.710240 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.710850 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.712753 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.740342 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1444/2879] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:19 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:19.744371 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.754344 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9291599-8d15-4d50-9c23-e16fc48e5993 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.812884 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.813491 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.813798 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.814072 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.814687 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.816644 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.837661 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1436/2880] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:19 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:19.841789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.852807 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10cc6c-7f00-41ac-83e4-65bf2b66747a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.857628 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.858224 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.858516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.858769 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.859406 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.861084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.870989 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1445/2881] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:19.874865 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.881399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:19.885257 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00960aa8-dbe2-4ad0-880a-53810eed66b7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.891141 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.891924 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.892397 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.892711 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.893444 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.896399 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114a1b-c485-47c6-8833-aec3b538d5a1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.907158 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1437/2882] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:19.912195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:19.922032 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36e875-a5ae-464e-b2be-fe6b1c1c588d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:19.927891 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:19.928583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.928866 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.929143 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] PATH_INFO: `/v3/projects/f85959e328174872bd037c33ed96aebb/users/0d797f35458642a193e9bf29f056611c/roles/d8fc7d1921fd4f0981a9ce7cc51aee22` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.944627 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85959e328174872bd037c33ed96aebb, user_id=0d797f35458642a193e9bf29f056611c, role_id=d8fc7d1921fd4f0981a9ce7cc51aee22)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:19.947263 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:19.962132 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1446/2883] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:19 2022] PUT /identity/v3/projects/f85959e328174872bd037c33ed96aebb/users/0d797f35458642a193e9bf29f056611c/roles/d8fc7d1921fd4f0981a9ce7cc51aee22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:19.967077 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce102-455c-4476-92a2-ce0aa29f8d2a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:19.967560 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce102-455c-4476-92a2-ce0aa29f8d2a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:19.967679 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce102-455c-4476-92a2-ce0aa29f8d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:19.986317 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3d7ce102-455c-4476-92a2-ce0aa29f8d2a None None] MFA Rules not processed for user `0c82076d9dfe480f9a7e9f70455b47e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:19.987527 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3d7ce102-455c-4476-92a2-ce0aa29f8d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:20.052398 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1438/2884] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:20.061876 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:20.063581 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:20.126432 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18e01e-2eac-408d-ad03-5bc64d3e70cb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:20.130136 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faba61a963e149c3a09e17bed3c2ce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:20.130738 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:20.131020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:20.131293 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:20.140167 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:20.141632 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:20.151158 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1447/2885] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:20.769128 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:20.770015 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:20.770289 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:20.798792 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] MFA Rules not processed for user `0d797f35458642a193e9bf29f056611c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:20.800061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:20.868039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1439/2886] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:20.872800 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:20.882726 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79ae4a-4398-4d19-94e9-9e22918f5ddf service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:20.887942 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:20.888587 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:20.888864 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:20.889130 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:20.889747 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:20.891730 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:20.920201 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1448/2887] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 10 17:14:20 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:20.924395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:20.936805 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561f883-1117-4aa8-b868-7bde5c00a4a9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:20.993438 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:20.994124 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:20.994333 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:20.994600 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:20.995239 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:20.997242 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:21.018153 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1440/2888] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 10 17:14:20 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 17:14:21.022821 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:21.032970 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b14d1-637d-444b-adf1-7ac33ddfe6af admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:21.038270 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:21.038855 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.039135 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.039402 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:21.040040 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:21.041643 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:21.052141 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1449/2889] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:21.056351 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:21.066588 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1cef5-10f6-4837-8eec-f897956f8b6a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:21.071249 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:21.071895 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.072179 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.072455 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] PATH_INFO: `/v3/projects/5e15a0e070eb42848ad88f105b9942ca/users/c173185b28aa4b61996cd85bfdccb8bf/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:21.084262 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:21.088868 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e15a0e070eb42848ad88f105b9942ca, user_id=c173185b28aa4b61996cd85bfdccb8bf, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:21.091604 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:21.105619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1441/2890] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:21 2022] PUT /identity/v3/projects/5e15a0e070eb42848ad88f105b9942ca/users/c173185b28aa4b61996cd85bfdccb8bf/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:21.109673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:21.119880 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bb6f5-d97e-4633-9a63-4c1dd03def3e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:21.124458 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:21.178070 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:21.178673 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.178950 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.179219 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:21.179870 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:21.181466 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cf475-96f5-437f-bc14-ed86a02012f8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:21.191037 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1450/2891] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 10 17:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 17:14:21.195330 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:21.205683 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298bec9-3a9b-423a-86df-667f39122ce7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:21.211719 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:21.212395 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.212701 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.212981 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] PATH_INFO: `/v3/projects/5e15a0e070eb42848ad88f105b9942ca/users/c173185b28aa4b61996cd85bfdccb8bf/roles/d9d7215675154ba89ce19eaa12ac8f1e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:21.214870 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e15a0e070eb42848ad88f105b9942ca, user_id=c173185b28aa4b61996cd85bfdccb8bf, role_id=d9d7215675154ba89ce19eaa12ac8f1e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:21.217557 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be33e9-7c8b-4662-b1e1-7bdb62a78208 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:21.228293 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1442/2892] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 10 17:14:21 2022] PUT /identity/v3/projects/5e15a0e070eb42848ad88f105b9942ca/users/c173185b28aa4b61996cd85bfdccb8bf/roles/d9d7215675154ba89ce19eaa12ac8f1e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:21.870995 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.871283 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.871560 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:21.901360 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] MFA Rules not processed for user `c173185b28aa4b61996cd85bfdccb8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:21.902660 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:21.976175 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1451/2893] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:21.986484 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:21.986764 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:21.987027 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:22.006251 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] MFA Rules not processed for user `0d797f35458642a193e9bf29f056611c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 17:14:22.007443 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:22.065515 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1443/2894] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 10 17:14:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 17:14:22.076251 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:22.077781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:22.149393 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e961f-4946-420b-9f4d-9406f44af451 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:22.154826 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca316ae3b4d84309af586fbb5aa61dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:22.155411 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:22.155688 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:22.156047 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:22.164640 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:22.166214 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:22.175173 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1452/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:32.058906 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=34,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:32.171275 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:35.942302 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:35.943767 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:36.001673 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f26bc-ba02-4fb3-a898-aec72c229140 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:36.005433 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb66e8f0439d48fd9805921211801b65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:36.006039 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:36.006322 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:36.006596 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:36.016578 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:36.018042 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:36.028422 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1444/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:46.024240 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=26 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:55.647624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:55.649127 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:55.715771 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:55.730650 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772cc98-c232-4d8a-8ec3-e40c19b53d71 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:55.735781 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:55.736322 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:55.736631 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:55.736904 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:55.738721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:55.752962 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:55.754483 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:55.764583 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1453/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:14:55.781818 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a3486-94be-4fd1-85e6-6a1ce6b16360 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:55.786511 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:55.787138 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:55.787411 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:55.787682 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] PATH_INFO: `/v3/users/0d797f35458642a193e9bf29f056611c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:55.789480 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d797f35458642a193e9bf29f056611c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:55.791386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:55.839856 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d797f35458642a193e9bf29f056611c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:55.847108 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d797f35458642a193e9bf29f056611c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:55.848004 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d797f35458642a193e9bf29f056611c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:55.848590 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d797f35458642a193e9bf29f056611c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:55.856061 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d797f35458642a193e9bf29f056611c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:55.873118 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1445/2898] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:55 2022] DELETE /identity/v3/users/0d797f35458642a193e9bf29f056611c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:14:56.053905 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:56.064610 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1639a-6ead-4b3e-a42d-80fc35035c31 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:56.124096 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:56.124749 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:56.125033 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:56.125308 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] PATH_INFO: `/v3/projects/f85959e328174872bd037c33ed96aebb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:56.126417 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85959e328174872bd037c33ed96aebb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:56.128328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:56.173182 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85959e328174872bd037c33ed96aebb', 'request_id': 'req-31db7050-bacb-42bf-874a-1fcc5a796624'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.178941 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85959e328174872bd037c33ed96aebb', 'request_id': 'req-31db7050-bacb-42bf-874a-1fcc5a796624'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.185170 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85959e328174872bd037c33ed96aebb', 'request_id': 'req-31db7050-bacb-42bf-874a-1fcc5a796624'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.198027 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] The token cache is being invalidate because project f85959e328174872bd037c33ed96aebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:56.198309 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.198919 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.200452 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1454/2899] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:56 2022] DELETE /identity/v3/projects/f85959e328174872bd037c33ed96aebb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:56.204386 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:56.206114 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:56.219669 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7eec1c-f4d1-4dc5-a137-a3f67ec3f882 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:56.275583 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:56.276127 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:56.276408 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:56.276705 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] PATH_INFO: `/v3/users/c173185b28aa4b61996cd85bfdccb8bf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:56.277816 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c173185b28aa4b61996cd85bfdccb8bf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:56.279712 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:56.300304 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:56.324576 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c173185b28aa4b61996cd85bfdccb8bf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.332174 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c173185b28aa4b61996cd85bfdccb8bf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.332801 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c173185b28aa4b61996cd85bfdccb8bf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.333448 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c173185b28aa4b61996cd85bfdccb8bf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.340997 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c173185b28aa4b61996cd85bfdccb8bf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.357672 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1446/2900] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:14:56 2022] DELETE /identity/v3/users/c173185b28aa4b61996cd85bfdccb8bf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:14:56.533301 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:14:56.534785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:14:56.548759 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7050-bacb-42bf-874a-1fcc5a796624 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:14:56.566539 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:14:56.609923 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:14:56.610568 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:14:56.610839 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:14:56.611103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] PATH_INFO: `/v3/projects/5e15a0e070eb42848ad88f105b9942ca` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:14:56.612195 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e15a0e070eb42848ad88f105b9942ca)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:14:56.614103 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:14:56.662517 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e15a0e070eb42848ad88f105b9942ca', 'request_id': 'req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.668062 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e15a0e070eb42848ad88f105b9942ca', 'request_id': 'req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.674168 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e15a0e070eb42848ad88f105b9942ca', 'request_id': 'req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.687590 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] The token cache is being invalidate because project 5e15a0e070eb42848ad88f105b9942ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:14:56.687875 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.688601 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:14:56.690304 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1455/2901] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:14:56 2022] DELETE /identity/v3/projects/5e15a0e070eb42848ad88f105b9942ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:15:06.354228 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:06.684436 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:41.624232 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:15:41.626606 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:15:41.647517 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c24b9-8289-43d5-a832-157a25ec5c08 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:15:41.712710 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:15:41.713341 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:15:41.713619 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:15:41.713890 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] PATH_INFO: `/v3/users/c1d5dfa59f79433a9d5c3d3bdbeafb4d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:15:41.714992 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d5dfa59f79433a9d5c3d3bdbeafb4d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:15:41.716930 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:15:41.765750 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d5dfa59f79433a9d5c3d3bdbeafb4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:41.774034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d5dfa59f79433a9d5c3d3bdbeafb4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:41.774647 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d5dfa59f79433a9d5c3d3bdbeafb4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:41.775365 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d5dfa59f79433a9d5c3d3bdbeafb4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:41.783967 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d5dfa59f79433a9d5c3d3bdbeafb4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:41.802013 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1447/2902] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:15:41 2022] DELETE /identity/v3/users/c1d5dfa59f79433a9d5c3d3bdbeafb4d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 17:15:41.977899 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:15:41.979573 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:15:41.994783 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc6a6-90cb-4499-a295-cfa5f96bdfe2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:15:42.053551 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:15:42.054190 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:15:42.054516 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:15:42.054789 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] PATH_INFO: `/v3/projects/a639e90112b44c99856bdb32a58afa19` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:15:42.055883 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a639e90112b44c99856bdb32a58afa19)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:15:42.057785 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:15:42.103977 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a639e90112b44c99856bdb32a58afa19', 'request_id': 'req-70e78845-876e-4e80-b7c6-a2c18ebdce99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.109440 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a639e90112b44c99856bdb32a58afa19', 'request_id': 'req-70e78845-876e-4e80-b7c6-a2c18ebdce99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.115461 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a639e90112b44c99856bdb32a58afa19', 'request_id': 'req-70e78845-876e-4e80-b7c6-a2c18ebdce99'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.129849 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] The token cache is being invalidate because project a639e90112b44c99856bdb32a58afa19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:15:42.130137 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.130782 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.132255 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1456/2903] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:15:41 2022] DELETE /identity/v3/projects/a639e90112b44c99856bdb32a58afa19 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:15:42.136250 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:15:42.137787 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:15:42.151531 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a5a07-2c64-43b4-aa8c-ec0ab3d81efb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:15:42.207522 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:15:42.208147 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:15:42.208429 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:15:42.208734 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] PATH_INFO: `/v3/users/c5d2e64040414aefa8d5a5bd23a9850c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:15:42.209830 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d2e64040414aefa8d5a5bd23a9850c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:15:42.211731 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:15:42.233594 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:42.258135 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d2e64040414aefa8d5a5bd23a9850c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.265413 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d2e64040414aefa8d5a5bd23a9850c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.266034 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d2e64040414aefa8d5a5bd23a9850c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.266637 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d2e64040414aefa8d5a5bd23a9850c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.273986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d2e64040414aefa8d5a5bd23a9850c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.291025 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1448/2904] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 10 17:15:42 2022] DELETE /identity/v3/users/c5d2e64040414aefa8d5a5bd23a9850c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:15:42.471624 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:15:42.473084 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:15:42.486647 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78845-876e-4e80-b7c6-a2c18ebdce99 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:15:42.544371 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c82076d9dfe480f9a7e9f70455b47e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac92c6a1cc54a05870dbe2cd79f672b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:15:42.545020 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:15:42.545934 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:15:42.546213 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] PATH_INFO: `/v3/projects/08bcd5e4c87245c39ae8a952347f4db0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:15:42.547328 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bcd5e4c87245c39ae8a952347f4db0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:15:42.549244 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:15:42.583764 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:42.597634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bcd5e4c87245c39ae8a952347f4db0', 'request_id': 'req-6015756f-e0e0-4512-9f87-e495157012d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.603059 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bcd5e4c87245c39ae8a952347f4db0', 'request_id': 'req-6015756f-e0e0-4512-9f87-e495157012d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.609836 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bcd5e4c87245c39ae8a952347f4db0', 'request_id': 'req-6015756f-e0e0-4512-9f87-e495157012d6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.621721 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] The token cache is being invalidate because project 08bcd5e4c87245c39ae8a952347f4db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 17:15:42.622012 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.622634 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6015756f-e0e0-4512-9f87-e495157012d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 17:15:42.624210 dv-cinder-836027-6-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1457/2905] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 10 17:15:42 2022] DELETE /identity/v3/projects/08bcd5e4c87245c39ae8a952347f4db0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 17:15:52.287534 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:15:52.618784 dv-cinder-836027-6-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 17:17:13.730986 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 17:17:13.732410 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:17:13.801154 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5a797-54f5-454c-8e26-b3a79e7f1f1e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 17:17:13.859657 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5c3ba51f2c4d5583dbd3ebbafed5ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a83921ca1624455aab3f5f5cbb59aca2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 17:17:13.860296 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 17:17:13.860675 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 17:17:13.860953 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 17:17:13.862754 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 17:17:13.874134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 17:17:13.875715 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898f6a-72cf-442b-b3fc-e1c1b159c0be service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 17:17:13.886134 dv-cinder-836027-6-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1449/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 10 17:17:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 17:17:23.881950 dv-cinder-836027-6-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=58 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}